Antiosteoporosis Effect and Possible Mechanisms of the Ingredients of Fructus Psoraleae in Animal Models of Osteoporosis: A Preclinical Systematic Review and Meta-Analysis

Lin, Zhou; Zheng, Junju; Chen, Jiaru; Chen, Mangmang; Dong, Shuangxia

doi:https://doi.org/10.1155/2021/2098820

Oxidative Medicine and Cellular Longevity

On this page

Abstract Introduction Methods Results Discussion Conclusion Abbreviations Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Special Issue

Bioactive Compounds of Food: Their Role in The Prevention and Treatment of Diseases 2021

View this Special Issue

Review Article | Open Access

Volume 2021 | Article ID 2098820 | https://doi.org/10.1155/2021/2098820

Antiosteoporosis Effect and Possible Mechanisms of the Ingredients of Fructus Psoraleae in Animal Models of Osteoporosis: A Preclinical Systematic Review and Meta-Analysis

Zhou Lin,¹Junju Zheng,¹Jiaru Chen,¹Mangmang Chen,¹and Shuangxia Dong²

Academic Editor: German Gil

Received25 Aug 2021

Accepted09 Nov 2021

Published24 Nov 2021

Abstract

Objective. Fructus Psoraleae (FP) and its ingredients (IFP) have a variety of biological activities and are widely used to treat osteoporosis (OP). Herein, we conducted a systematic review to evaluate the efficacy of IFP for an animal model of OP from the current literatures. Potential mechanisms of IFP in the treatment of OP were also summarized. Materials and Methods. We carried out a search for electronic literature in the PubMed, Chinese National Knowledge Infrastructure, EMBASE, Wanfang, Web of Science, Chinese Biomedical Literature Database, and Cochrane Library, as well as Chinese VIP databases targeting articles published from inception to June 2021. The inclusion criteria were animal studies that assessed the efficacy and safety of IFP for OP, regardless of publication status or language. The exclusion criteria included (1) other types of studies (in vitro studies, case reports, clinical trials, reviews, abstracts, comments, and editorials), (2) combination with other compounds, (3) compared with other traditional Chinese medicine, (4) not osteoporosis or bone loss model, (5) studies with insufficient data, (6) lack of a control group, and (7) duplicate publications. The modified Collaborative Approach to Meta-Analysis and Review of Animal Data from Experimental Stroke (CAMARADES) 10-item quality checklist was used to evaluate the risk of bias of included studies. We computed the relative risk (RR) and the standard mean difference (SMD) for dichotomous outcomes and continuous outcomes, respectively. When heterogeneity was detected or there was significant statistical heterogeneity ( or ), a random-effects model was employed, followed by further subgroup analysis and metaregression estimations to ascertain the origins of heterogeneity. Otherwise, we used a fixed-effects model ( or ). The primary outcome measures were bone mineral density (BMD), serum osteocalcin(S-OCN), bone volume over total volume (BV/TV), trabecular number (Tb.N), trabecular thickness (Tb.Th), trabecular separation (Tb.Sp), bone maximum load, and elasticity modulus. The secondary outcome measure was the antiosteoporosis mechanisms of IFP. The STATA 12.0 software was used to analyze the data. Results. Overall, 16 studies focusing on 379 animals were enrolled into the study. The risk of bias score of included studies ranged from 4 to 7 with an average score of 5.25. The present study provided the preliminary preclinical evidence that administration of IFP could significantly increase the S-OCN, BMD, BV/TV, and Tb.N while Tb.Th and Tb.Sp were remarkably decreased by IFP in OP model animals (). Moreover, IFP could significantly improve the bone biomechanical indicator bone maximum load and elasticity modulus (). In terms of the possible mechanisms of treatment of OP, IFP exerts anti-OP effects in animal models probably through osteoprotegerin/receptor activator of the nuclear factor-κB ligand/receptor activator of nuclear factor-κB (OPG/RANKL/RANK), peroxisome proliferator activated receptor γ (PPAR-γ)/Axin2/Wnt, antioxidative stress via forkhead box O3a (FoxO3a)/Axin2/Wnt, phosphatidylinositol 3-kinase/protein kinase B/mammalian target of rapamycin (PI3K/Akt/mTOR), estrogen-like effect, and gamma-aminobutyric acid/gamma-aminobutyric acid receptor (GABA/GABA_BRI) signaling pathway. Conclusion. Taken together, the findings suggest the possibility of developing IFP as a drug or an ingredient in diet for the clinical treatment of OP. We recommend that rigorous, as well as high-quality, trials involving large sample sizes should be conducted to confirm our findings.

1. Introduction

Osteoporosis (OP), is a systemic skeletal disease characterized by loss of bone mass and bone microarchitectural deterioration, resulting in increased bone fragility and a greater risk of fractures, especially in the spine, hip, and wrist [1, 2]. Many risk factors are associated with OP, including age, race, smoking, alcohol, low physical activity, hormone-related factors, drugs such as glucocorticoids, low calcium, and vitamin D levels [3]. Reports have showed that about 9.9 million Americans suffer from OP, with an additional 43.1 million experiencing low bone mineral density [4]. In China, the prevalence of OP was 14.94% before 2008 and increased to 27.96% from 2012 to 2015, with the rate being higher in females relative to males [5]. Approximately, in the United States, 16% of men and 29.9% of women aged more than 50 years have OP on the basis of the diagnostic criteria of the National Bone Health Alliance [6]. With the aggravation of global population aging, OP has become a serious global health problem. OP has been attributed to decreased quality of life and increased risks of death along with an elevated burden on health systems economically [7]. Thus, the management of patients with OP is extremely urgent.

Up to now, calcium and vitamin D supplementation are the standard choices for OP treatment [8]. Pharmacological therapies, including bisphosphonates, denosumab, and teriparatide, are also recommended to reduce the risk of vertebral or hip fractures in patients with OP [9]. Estrogen therapy, menopausal estrogen plus progestogen therapy, or raloxifene is suitable for postmenopausal women [10]. However, despite the availability of numerous anti-OP medications with diverse pharmacological properties, as well as fixed-dose combination therapy, the targeted therapeutic effect is not attained in significant numbers of individuals with OP, and the mitigation of OP fracture has remained suboptimal [11, 12]. Therefore, finding a drug that is effective and safe for osteoporosis is an important challenge for the industry.

Recently, the growing utilization of complementary and alternative medicine consists of herbal medicine in research and in clinical practice medicinal: they usually have few side effects and are easily accessible [13, 14]. Herbal medicines are typically used as a complementary and adjunct therapy for a wide range of diseases such as OP [15]. Fructus Psoraleae (FP) is the dried matured fruits of Psoralea corylifolia Linn, which has a long history and a wide range of applications in Asia, particularly in China, Japan, and Korea for their effects on OP and bone fracture [16]. Studies have shown that FP has the effects of dilating coronary artery, increasing coronary blood flow, antitumor, protecting liver, estrogen-like, and anti-OP effects [17]. The ingredients of FP (IFP) are shown in Figure 1, which mainly contains furanocoumarins (mainly psoralen and isopsoralen), coumestrol (such as psoralidin), flavonoids (mainly corylifolin, corylifolinin, corylin, and bavachalcone), and phenolic terpenoids (such as bakuchiol). Many IFP have estrogen-like effects [18]. Recent reports have shown that phytoestrogens have anti-OP effects similar to natural estrogen with less estrogen-like side effects [19]. Several studies have demonstrated that multiple IFP may possess anti-OP effects both in vivo and vitro [20, 21]. Corylifolin could prevent estrogen deficiency-induced bone loss in ovariectomized rats and induced primary human osteoblast differentiation [20]. Psoralen and bakuchiol improved osteoclast differentiation and bone resorption via inhibiting the protein kinase B (AKT) and activator protein-1 (AP-1) pathway [21]. However, the scattered evidence and uncertain mechanisms limited the application of FP and IFP in the clinic. Systematic review and meta-analysis of animal studies are considered to be a valuable tool to provide important insights into the validity of animal studies, improve the precision of estimated effects, and support further generalization to human clinical trials [22]. We speculated that IFP could exert anti-OP effects in animal models of OP. However, it is difficult to translate these beneficial effects of IFP from basic research to clinical application. Besides, the uncertain mechanisms and adverse drug reaction of IFP should also be taken into consideration, which were also the uncertainties and conflicts that underlie the hypotheticals. The evidence of studies was beneficial to find out a potential medication to prevent OP for healthy individuals and to treat OP for OP patients with less adverse drug reaction. Now clinically, FP has not been used to treat OP and there is a lack of clinical evidence, which is the focused clinical question we review and address in our study. Our study might provide a theoretical basis for the application of FP in OP. Therefore, we presented a systematic review and meta-analysis from the preclinical evidence of IFP in animal models of OP to summarize the significant outcomes on efficacy and mechanisms.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

2. Methods

We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement (Table 1) to perform a systematic review and meta-analysis [23]. There are no protocols preregistered for this review.

2.1. Database and Search Strategies

Electronic searches were performed in eight databases from their respective inception to June 2021: PubMed, EMBASE, Web of Science, Cochrane Library, Chinese National Knowledge Infrastructure, Chinese Biomedical Literature Database, Chinese VIP Database, and Wanfang Database. No language restrictions were applied. The following search terms were used in PubMed and were modified to suit other databases: “Fructus Psoraleae extract” AND “Osteoporosis.” In addition, reference lists from the resulting publications and reviews were also searched carefully for the eligible studies.

2.2. Eligibility Criteria

The studies were included according to the following PICOS criteria.

2.2.1. Types of Participants

We included controlled studies assessing the administration of IFP for OP animal models established by different methods, regardless of animal species, age, weight, and gender.

2.2.2. Types of Interventions

The treatment group received IFP as monotherapy, regardless of dosage, medicament type, route of administration, and time for the medicine application.

2.2.3. Types of Controls

Blank treatment or isometric placebo was received in the control group.

2.2.4. Types of Outcome Measures

The primary outcome measures were the following: (1) bone mineral density (BMD, including BMD-lumbar spine and BMD-femur), (2) serum osteocalcin(S-OCN), (3) bone volume over total volume (BV/TV), (4) trabecular number (Tb.N), (5) trabecular thickness (Tb.Th), (6) trabecular separation (Tb.Sp), (7) bone maximum load, and (8) elasticity modulus. The secondary outcome measure was the antiosteoporosis mechanisms of IFP.

2.2.5. Types of Studies

Only animal studies that assessed the efficacy and safety of IFP for OP were included, regardless of publication status or language.

2.3. Exclusion Criteria

Exclusion criteria are as follows: (1) other types of studies (in vitro studies, case reports, clinical trials, reviews, abstracts, comments, and editorials), (2) combination with other compounds, (3) compared with other traditional Chinese medicines, (4) not osteoporosis or bone loss model, (5) studies with insufficient data, (6) lack of control group, and (7) duplicate publications.

2.4. Selection of Literature

We used the PRISMA flow diagram to select the included studies. The results of literature search were imported into the software Endnote X7. Two authors independently assessed the potentially eligible studies. Firstly, the titles and abstracts were screened to exclude the duplicated and apparently irrelevant ones or those that do not meet our inclusion criteria. After that, the remaining potential studies were full-text downloaded and reviewed. Any disagreement between the two above authors was sent and discussed with the third independent author.

2.5. Data Extraction

Two reviewers independently extracted data, and the third reviewer checked the consistency between them. A standard form was used; the extracted items included the general study information: the author’s name(s), publishing date, animal species, age, gender, weight, sample size, OP modeling method, the use of anesthetics in the course of the experiment, the therapeutic regimen of the treatment and control groups, and primary and secondary outcomes and its intergroup differences. For continuous outcomes, we extracted the mean, standard deviation (SD), and participant number. The data in other forms was recalculated when possible to enable pooled analysis. If the study was involved in multiple intervention groups, we extracted data only for the group(s) involving IFP and the control group(s). Disagreements between two researchers were resolved by discussion. Whenever necessary, we contacted the authors of the studies for the missing data and additional information.

2.6. Quality Assessment of Included Studies

Two authors independently performed methodological quality and risk of bias assessment of the included studies using the CAMARADES 10-item quality checklist with minor modification [24]. The modification is listed as follows: D: blinded induction of model (group randomly after modeling), F: use of anesthetic without significant protective and toxic effects on bones, and G: appropriate animal model with complications or risk factors (including age, hyperlipidemia, diabetes, or hypertensive).

2.7. Quality Assessment of Evidence

The assessment of evidence quality was evaluated according to the GRADE criteria [25, 26]. The evidence quality of included outcomes was graded as high, moderate, low, or very low. RCTs were initially classified as having high-quality evidence. The quality of each outcome was downgraded for the following five factors: risk of bias, inconsistency, indirectness, imprecision, and publication bias. GRADE pro3.6.1 software was used for the data analysis and synthesis.

2.8. Statistical Analysis

The data was collected and input into the STATA software (version 12.0; StataCorp, College Station, TX) for meta-analysis. A random-effects model was applied when heterogeneity was detected or the statistical heterogeneity was high ( or ), and then, further subgroup study and metaregression analysis (the number of included studies was more than ten) were performed to detect the origin of heterogeneity. Otherwise, a fixed-effects model was used ( or ). To test the strength and stability of the pooled results, we performed a sensitivity analysis by omitting the individual studies one by one. Moreover, the effect of publication bias was investigated by Egger’s test. Standard mean difference (SMD) was calculated for continuous outcomes.

3. Results

3.1. Study Selection

We identified 130 potentially relevant hints from eight databases. Removing duplication of literature, there were 62 articles left. We excluded 10 studies that are not related to this study after reading the titles and abstracts in detail. Through reading the full text of 52 articles, 36 articles were excluded for at least one of the exclusion criteria. Finally, 16 articles [17, 27–41] were included for analysis. Figure 2 presents the detailed flow diagram of the search and selection process.

3.2. General Characteristics of the Included Studies

The characteristics of all the 16 included studies are summarized and shown in Table 2. All of them were published between 2008 and 2021. All studies involved a total of 379 subjects with 191 in the experimental group vs. 188 in the control group. As for animal species, Sprague-Dawley rats were used in ten studies [27–29, 31, 32, 34, 37–39, 41], Wistar rats in three [17, 30, 40], C57BL/6 mice in two [35, 36], and ICR mice in one [33]. The weight of rats varied between 160 g and 290 g, while the weight of mice varied between 16.6 g and 22 g. Eleven studies [29, 31, 33–41] established an OP model by bilateral oophorectomy, two studies [27, 30] by intramuscular injection of DXM (2.5 mg/kg, biw) for 12 weeks, two studies [17, 28] by oral gavage of 7% tretinoin (10 ml/kg/d, qd) for 2 weeks, and 1 study [32] by oral gavage of prednisone (0.005 mg/kg/d, qd) for 14 weeks. Anesthetics were reported in ten studies [17, 27, 29, 32–34, 37–40], of which chloral hydrate was reported in five studies [27, 29, 32–34], pentobarbital sodium in four studies [17, 37–39], and ketamine in one study [40]. Detailed information of IFP in each study is displayed in Table 3. With regard to the specific IFP, isopsoralen was reported in five studies [27, 28, 32, 34, 36], psoralen in seven studies [17, 29–31, 35, 37, 40], bakuchiol in two studies [33, 41], psoralidin in one study [39], and bavachin in one study [38]. Fifteen studies [17, 27–40] used a dose gradient of IFP by oral administration ranging from 16 mg/kg/d to 1.26 g/kg/d, and one study [41] used subcutaneous injection administration by 30 mg/kg/d. In terms of primary outcome, BMD-femur was measured in twelve studies [27–32, 34, 37–41], BMD-lumbar spine in seven studies [27–29, 32, 34, 37, 39], S-OCN in five studies [28–30, 32, 40], BV/TV in five studies [27, 31, 33, 36, 37], Tb.N in six studies [17, 27, 31, 33, 36, 37], Tb.Th in four studies [17, 31, 33, 36], Tb.Sp in five studies [17, 31, 33, 36, 37], bone maximum load in six studies [30–32, 34, 35, 37], and elasticity modulus in six studies [30, 31, 34, 35, 37, 39].

3.3. Study Quality

The CAMARADES 10-item quality checklist was adopted to judge the risk of bias of each study, and the number of criteria met varied from 4/10 to 7/10 with the average of 5.25. Detailed results of methodological quality are presented in Table 4. All the included studies were peer-reviewed publications; three studies [31, 37, 39] did not mention control of temperature. Two [32, 34] of the included studies did not declare randomisation. The ways of blinding induction of model were reported in seven studies [29–31, 33, 35, 36, 41], and all of them reported that the animals were grouped randomly after modeling. No study mentioned the calculation of the sample size, and none used a blinding method during outcome assessment and an appropriate animal model. Ten studies [17, 27, 29, 32–34, 37–40] used the anesthetic without protective and toxic effects on bones. Compliance with animal welfare regulations was not described in four studies [33, 35, 37, 40], and the potential conflict of interests was not mentioned in four studies [30, 32, 35, 40].

3.4. Effectiveness

3.4.1. S-OCN

Five studies [28–30, 32, 40] compared IFP with a control group regarding S-OCN. As shown in Figure 3, the pooled results showed that IFP significantly increased the S-OCN in contrast with control (; ; ; heterogeneity , , , , Figure 3).

3.4.2. BMD

(1) BMD-Femur. Twelve studies [27–32, 34, 37–41] reported IFP with the control group according to BMD at the femur. The pooled results indicated that IFP was significant for lifting BMD at the femur compared to the control group (; ; , heterogeneity , , , , Figure 4). The causes of heterogeneity in the results were explored by metaregression. The metaregression analysis for sample size, intervention time, dosage of IFP, publication year, and age of animals (weeks) was performed to analyze the potential sources of interstudy heterogeneity (Figure 5). Overall, the sample size (; ; ) might be one of the sources of heterogeneity. However, intervention time (; ; ), publication year (; ; ), dosage of IFP (; ; ), and age of animals (; ; ) were not the major causes of heterogeneity for BMD at the femur.

(a)

(b)

(c)

(d)

(e)

(2) BMD-Lumbar Spine. Seven studies [27–29, 32, 34, 37, 39] compared IFP with the control group about the BMD at the lumbar spine. As shown in Figure 6, the pooled results showed that IFP was significant for improving BMD at the lumbar spine compared with the control group (; ; ; heterogeneity , , , ).

3.4.3. BMD-Related Indicator under Micro-CT

(1) BV/TV. Five studies [27, 31, 33, 36, 37] reported IFP versus the control group according to BV/TV. The pooled results indicated that IFP was significant for raising BV/TV compared to the control group (; ; ; heterogeneity , , , , Figure 7(a)).

(a)

(b)

(c)

(d)

(2) Tb.N. There were six studies [17, 27, 31, 33, 36, 37] comparing IFP with the control group about Tb.N. The pooled results indicated that IFP significantly increased Tb.N compared to the control group (; ; ; heterogeneity , , , , Figure 7(b)).

(3) Tb.Th. Four studies [17, 31, 33, 36] compared IFP with the control group regarding the Tb.Th. As shown in Figure 7(c), the pooled results showed that IFP was significant for decreasing Tb.Th compared with the control group (; ; ; heterogeneity , , , ).

(4) Tb.Sp. Five studies [17, 31, 33, 36, 37] compared IFP with the control group with regard to Tb.Sp. The available data demonstrated that IFP significantly reduced Tb.Sp in contrast with the control group (; ; ; heterogeneity , , , , Figure 7(d)).

3.4.4. Bone Biomechanical Indicator

(1) Bone Maximum Load. There were six studies [30–32, 34, 35, 37] comparing IFP with the control group about the bone maximum load. The pooled results indicated that IFP significantly improved bone maximum load compared to the control group (; ; ; heterogeneity , , , , Figure 8(a)).

(a)

(b)

(2) Elasticity Modulus. Six studies [30, 31, 34, 35, 37, 39] reported IFP with the control group according to elasticity modulus. The pooled results indicated that elasticity modulus in the IFP group was significantly larger than that in the control group (; ; ; heterogeneity , , , , Figure 8(b)).

3.5. Subgroup Analysis

The potential confounding factors (including animal species, modeling methods, kind of IFP, sample size, and dosages of IFP) that may increase the heterogeneity of outcome measures were explored using subgroup analysis of BMD-femur and BMD-lumbar spine. As for BMD-femur, the subgroup analysis of animal species showed that no difference was seen in the effect size between the SD rat group and the Wistar rat group ( versus , respectively, , Figure 9(a)), and heterogeneity of both groups did not decrease obviously. In the subgroup analysis of modeling methods, the ovariectomized model group showed better effect size than the nonovariectomized model group ( versus , respectively, , Figure 9(b)) with significantly reduced heterogeneity of both groups. In the subgroup analysis of kind of IFP, significant difference was found between the three groups ( versus versus , respectively, , Figure 9(c)), and the heterogeneity of the three groups decreased substantially. However, no difference was shown between the high-sample group (>20) and the low-sample group (≤20) ( versus , respectively, , Figure 9(d)). Besides, the high-dosage IFP group (>25 mg/kg, qd) showed greater effect size than in the low-dosage IFP (≤25 mg/kg, qd) ( versus , , Figure 9(e)), and heterogeneity of two groups reduced substantially. In terms of BMD-lumbar spine, the subgroup analysis of kind of IFP showed that no significant difference was revealed between the isopsoralen group and nonisopsoralen group ( versus , respectively, , Figure 10(a)) without a significant decline in heterogeneity between subgroups. In the subgroup analysis of modeling methods, the ovariectomized model group showed better effect size than the nonovariectomized model group ( versus , respectively, , Figure 10(b)) with significantly reduced heterogeneity of both groups. Moreover, the low-sample group (≤20) exhibited better effect size than the high-sample group (>20) ( versus , respectively, , Figure 10(c)), and the heterogeneity experienced a marked decline in the high-sample group, whereas no difference was found between the high-dosage IFP group (>25 mg/kg, qd) and the low-dosage IFP group (≤25 mg/kg, qd) ( versus , respectively, , Figure 10(d)) without a significant decrease in heterogeneity between subgroups.

(a)

(b)

(c)

(d)

(e)

(a)

(b)

(c)

(d)

3.6. Publication Bias and Sensitivity Analysis

Egger’s test (Figure 11) was used to assess the potential publication bias of the BMD-femur in this meta-analysis. The values from Egger’s tests indicated that there was no significant publication bias for BMD-femur ().

To determine the influence of each study on the pooled data for BMD-femur, BMD-lumbar spine, and BV/TV to verify the robustness of our results, sensitivity analysis was performed by omitting one study at a time and calculating the pooled data for the remaining studies. The results of the sensitivity analysis indicated that no significant effect was observed after excluding any single study, suggesting that the results of this meta-analysis were relatively robust (Figure 12).

(a)

(b)

(c)

3.7. GRADE Assessment

The GRADE system was used to assess the level of evidence for the outcomes, which indicated moderate, low, or very low quality with methodological problems and heterogeneity problem. The GRADE evidence profiles are shown in Table 5.

4. Discussion

4.1. Summary of Evidence

This is the first preclinical systematic review and meta-analysis to estimate the efficacy and possible mechanism of IFP for the OP animal model. Sixteen high-quality studies involving 379 animals with the OP model were enrolled in the analysis. The primary findings of present systematic review illustrated that IFP could significantly increase the S-OCN, BMD, BV/TV, and Tb.N while Tb.Sp and Tb.Th were remarkably decreased by IFP in OP model animals. Moreover, IFP could significantly improve the bone biomechanical indicator bone maximum load and elasticity modulus. Therefore, the findings revealed that FP is a potential anti-OP drug through multiple mechanisms. However, the outcomes BMD-femur, BMD-lumbar spine, and BV/TV represented high heterogeneity in our meta-analysis. According to the results of subgroup analysis and metaregression in our study, the source of heterogeneity was from the sample size, OP modeling methods, kind of IFP, and dosages of IFP. Thus, more high-quality studies involving large sample sizes should be conducted to confirm our findings.

4.2. Strengths

The strengths of this meta-analysis study consisted of a clearly defined research question, which reduced the bias in the choice of the included studies, fidelity, and consistency to a precise research approach that we designed before the meta-analysis, an in-depth search of the literature, the agreement between the two researchers regarding the entry data components, and the quality control appraisal of all the data. The quality of included original studies was relatively moderate, which suggests that the results were relatively reliable. Additionally, the number of trials and the overall sample size was comparatively large (16 trails with 379 animals). We performed subgroup assessments and metaregression evaluation to identify the origin of heterogeneity. Consequently, no publication bias was reported in this meta-analysis, and sensitivity estimation revealed that the findings of this meta-analysis are comparatively robust.

4.3. Limitations

Some limitations that may affect the accuracy of the study should be considered. Firstly, the included primary studies had some intrinsic and methodological shortcomings: (1) Only 14 trials had sufficient information on the generation of random allocation. (2) The blinding procedure and sample size calculation were not reported or remained unclear in some studies, making it a challenge to bias findings unintentionally or intentionally and to help allow the credibility of study conclusions. Secondly, selection bias was unavoidable because only eight frequently used databases were searched for English and Chinese language studies. Therefore, the potentially relevant studies published in other languages could have been left out. Thirdly, the absence of negative studies might have led to the true effect of IFP being overestimated. Fourthly, though the metaregression and subgroup analysis were done, the high heterogeneity of BMD-femur, BMD-lumbar spine, and BV/TV could not be neglected. The OP modeling methods, the specific kind of IFP, dosage of IFP, administration approaches, and period of IFP treatments differed remarkably in the included studies. This heterogeneousness could compromise the viability of our findings. Fifthly, most of the included studies in the meta-analysis were conducted in China, a potential limitation to the generalizability of our findings. Sixthly, the overall quality of evidence of this study was low (Table 5). Finally, many of the included studies suffer from significant sources of bias; this also will jeopardize the validity of results.

4.4. Implications

High-quality methodologies of studies are the cornerstones of translating animal research into clinical drug treatments for human disease [42]. The score (mean 5.25) by prudent assessment of included studies was better than that of most studies of traditional Chinese medicine [43]. There were limitations in terms of blinding and sample size calculation. The blinding methods in the animal model establishment and outcome assessment were usually seen as technical difficulties for most studies. A sample size calculation could avoid the waste of resources caused by oversize and the imprecision of study result by undersize; the specific steps could be referred from the literature [44]. Besides, the Animal Research: Reporting of In Vivo Experiments (ARRIVE) guidelines are aimed at improving the quality of research reports by guiding complete and transparent reporting of in vivo animal research. Employing of experimental animals with comorbidities such as advanced age, obesity, hyperglycemia, or other risk factors may be more in line with the physiology of OP patients and may be helpful for the clinical translation of experimental results. These should be adopted in the future study management of IFP for OP.

Using different animal models at different research stages of disease is crucial to study the pathophysiology and treatments [45]. Factors that need to be considered include pathogenesis of model, availability of the animals, technical requirements, and cost and ethical considerations [46]. According to the pathogenesis, animal models of OP can be divided into two types: models with increased bone resorption as the dominant mechanism (such as ovariectomized OP model, disused OP model, tretinoin induction OP model, nutritional OP model, and glucocorticoid OP model) and models with reduced bone formation as the dominant mechanism (such as senile OP model) [47]. This study comprehensively includes the ovariectomized OP model and nonovariectomized OP model (tretinoin induction OP model and glucocorticoid OP model) to evaluate the efficacy and mechanisms of IFP for OP. The results of subgroup analysis suggested that the ovariectomized OP model group showed better effect size than the nonovariectomized OP model group in regard to BMD-femur ( versus , respectively, , Figure 9(b)), which suggests that the different OP model methods may be the source of high heterogeneity. In clinical practice, postmenopausal OP has a similar pathogenesis with ovariectomized OP model [48]. The ovariectomized OP model has become the most widely used animal model to study OP [49], and it also was the most adopted model in eligible studies. Thus, we suggest an ovariectomized OP model be adopted to assess OP in future studies.

The results of subgroup analysis regarding the specific kind of IFP in BMD-femur demonstrated that the prosalen group gave a higher effect size than the isoprosalen group and neither the isoprosalen nor the prosalen group ( versus versus , respectively, , Figure 9(c)), indicating that different kinds of IFP might be the origin of high heterogeneity. Psoralen is one of the most major ingredients of FP and was also the most used IFP in the included studies (reported in 7 studies) because it has the highest content in FP and is easy to extract from FP. Besides, psoralen has been reported to possess potential anti-OP effects in animal OP models through multiple signal pathways [17, 29, 35]. For example, psoralen could significantly increase BMD of femur and vertebra, serum levels of calcium, osteocalcin, N-terminal propeptide of type 1 procollagen (P1NP), bone morphogenetic protein 2 (BMP2), and vascular endothelial growth factor (VEGF) via phosphatidylinositol 3-kinase/protein kinase B/mammalian target of rapamycin (PI3K/Akt/mTOR) in postmenopausal rats [29]. Isoprosalen is another furanocoumarin compound of FP and is derived from psoralen. Analogously, several studies have shown that isoprosalen exerted mighty protective effects of OP in animal OP models [27, 28, 36]. Isopsoralen could increase BMD and improve serological indicators inhibiting Axin2/peroxisome proliferator activated receptor (PPAR-γ) signaling pathway and activating Wnt signaling pathway in rats with glucocorticoid-induced OP [27]. Other IFP including bakuchiol, bavachin, and psoralidin were also reported in our included studies; however, the number of studies was relatively less and their effect size was lower than prosalen and isoprosalen. Therefore, prosalen and isoprosalen may be recommended as potential candidates of anti-OP drugs in the future studies. However, their safety and toxicity should be taken into consideration, which will be the direction of future research.

4.5. Possible Mechanisms

Systemic review of preclinical studies is conducive to understand comprehensively pathological mechanisms of disease and pharmacological effects of drugs [50]. The possible mechanisms of IFP that mediated anti-OP effects in the included studies are summed up as follows: (1) Osteoprotegerin/receptor activator of nuclear factor-κB ligand/receptor activator of nuclear factor-κB (OPG/RANKL/RANK) signal pathway: IFP could highly increase OPG secretion and reduce RANKL expression, resulting in an enhancement in OPG/RANKL ratio, which leads to a decrease in the number and activity of osteoclasts [30, 31, 34]. (2) PPAR-γ/Axin2/Wnt signal pathway: IFP suppressed the PPAR-γ/Axin2 signaling pathway involved in lipid metabolism, blocked the inhibition of Axin2 on the Wnt signaling pathway, upregulated the expression of β-catenin protein, and made β-catenin form a complex with nuclear transcription factors after entering the nucleus. Eventually, β-catenin activated the Wnt signaling pathway to regulate the lipid metabolism of rat bone marrow, thereby affecting bone metabolism and promoting bone formation [27]. Besides, the inhibition of PPAR-γ resulted in the increase of Runx2 expression, which facilitates osteogenic differentiation of bone mesenchymal stem cells in rats [36]. (3) Antioxidative stress through the forkhead box O3a (FoxO3a)/Axin2/Wnt signal pathway: IFP inhibited the activation of the FoxO3a signaling pathway through its antioxidant effect; meanwhile, it upregulated the expression of β-catenin, bound it to FoxO3a, initiated the transcriptional program that regulates bone tissue cell apoptosis and eliminates reactive oxygen species (ROS), which promotes the generation and formation of osteoblasts. Then, the expression of Axin2 was downregulated by removing excessive ROS, the PPAR-γ/Axin2 signaling pathway was inhibited to participate in lipid metabolism and the inhibition of Axin2 on the Wnt signaling pathway was blocked, which ultimately exerts its anti-OP effect [32]. (4) PI3K/Akt/mTOR signaling pathway: IFP restrained the expression of PI3K/Akt/mTOR in the rat’s femur and increased the levels of BMP2 and VEGF, which improves bone formation and angiogenesis [29]. (5) Estrogen-like effect: IFP had the similar effect of phytoestrogen on inhibiting bone resorption by participating in the binding of estrogen receptor. On the one hand, IFP may promote the synthesis and secretion of estrogen outside the ovary [40, 41]. On the other hand, it may enhance the secretion of thyroid calcitonin to exert it anti-OP effect [39]. (6) Gamma-aminobutyric acid/gamma-aminobutyric acid receptor (GABA/GABA_BRI) signaling pathway: IFP was observed to reduce the production of GABA and GABA_BRI to inhibit the activity of osteoblast [38]. The mechanism diagram is summarized in Figure 13.

5. Conclusion

This preclinical systematic review provided preliminary evidence that IFP was capable of partially exerting anti-OP effects in animal models probably through the OPG/RANKL/RANK, PPAR-γ/Axin2/Wnt, antioxidative stress via FoxO3a/Axin2/Wnt, PI3K/Akt/mTOR, estrogen-like effect, and GABA/GABA_BRI signaling pathway. Taken together, the findings suggest the possibility of developing IFP as a drug for the clinical treatment of OP.

Abbreviations

OP:	Osteoporosis
FP:	Fructus Psoraleae
IFP:	Ingredients of Fructus Psoraleae
SD:	Sprague-Dawley
DXM:	Dexamethasone
ISO:	Isopsoralen
PSO:	Psoralen
NS:	Normal saline
BMD:	Bone mineral density
F-BMD:	Femoral bone mineral density
L-BMD:	Lumbar bone mineral density
BV/TV:	Bone volume over total volume
Tb.N:	Trabecular linear density
Tb.Th:	Trabecular thickness
Tb.Sp:	Trabecular separation
PPAR-γ:	Peroxisome proliferator activated receptor γ
OCN:	Osteocalcin
Runx2:	Runt-related transcription factor 2
BMP2:	Bone morphogenetic protein 2
VEGF:	Vascular endothelial growth factor
PI3K:	Phosphatidylinositol 3-kinase
AKT:	Protein kinase B
mTOR:	Mammalian target of rapamycin
RANKL:	Receptor activator of nuclear factor-κ B ligand
OPG:	Osteoprotegerin
FoxO3a:	Forkhead box O3a
ROS:	Reactive oxygen species
GABA:	Gamma-aminobutyric acid
GABA_BRI:	Gamma-aminobutyric acid receptor.

Data Availability

Previously reported data were used to support this study. These prior studies and datasets are cited at relevant places within the text as references.

Conflicts of Interest

The authors declare that there is no conflict of interests regarding the publication of this study.

Authors’ Contributions

Z.L. was responsible for the conceptualization, methodology, and software. S.X.D. was responsible for data curation and writing of the initial draft. J.J.Z. was responsible for visualization and investigation. M.M.C. provided supervision. S.X.D. was responsible for software and validation. J.R.C. was responsible for reviewing and editing.

Acknowledgments

The authors thank all the staffs in the Wenzhou Central Hospital.

References

J. E. Compston, M. R. McClung, and W. D. Leslie, “Osteoporosis,” The Lancet, vol. 393, no. 10169, pp. 364–376, 2019.
View at: Publisher Site | Google Scholar
T. D. Rachner, S. Khosla, and L. C. Hofbauer, “Osteoporosis: now and the future,” The Lancet, vol. 377, no. 9773, pp. 1276–1287, 2011.
View at: Publisher Site | Google Scholar
N. E. Lane, “Epidemiology, etiology, and diagnosis of osteoporosis,” American Journal of Obstetrics and Gynecology, vol. 194, no. 2, pp. S3–11, 2006.
View at: Publisher Site | Google Scholar
N. C. Wright, A. C. Looker, K. G. Saag et al., “The recent prevalence of osteoporosis and low bone mass in the United States based on bone mineral density at the femoral neck or lumbar spine,” Journal of Bone and Mineral Research, vol. 29, no. 11, pp. 2520–2526, 2014.
View at: Publisher Site | Google Scholar
P. Chen, Z. Li, and Y. Hu, “Prevalence of osteoporosis in China: a meta-analysis and systematic review,” BMC Public Health, vol. 16, no. 1, p. 1039, 2016.
View at: Publisher Site | Google Scholar
N. C. Wright, K. G. Saag, B. Dawson-Hughes, S. Khosla, and E. S. Siris, “The impact of the new National Bone Health Alliance (NBHA) diagnostic criteria on the prevalence of osteoporosis in the USA,” Osteoporosis International, vol. 28, no. 4, pp. 1225–1232, 2017.
View at: Publisher Site | Google Scholar
M. Orive, U. Aguirre, S. García-Gutiérrez et al., “Changes in health-related quality of life and activities of daily living after hip fracture because of a fall in elderly patients: a prospective cohort study,” International Journal of Clinical Practice, vol. 69, no. 4, pp. 491–500, 2015.
View at: Publisher Site | Google Scholar
A. Reymondier, P. Caillet, F. Abbas-Chorfa et al., “MENOPOST--calcium and vitamin D supplementation in postmenopausal osteoporosis treatment: a descriptive cohort studyMENOPOST - calcium and vitamin D supplementation in postmenopausal osteoporosis treatment: a descriptive cohort study,” Osteoporosis International, vol. 24, no. 2, pp. 559–566, 2013.
View at: Publisher Site | Google Scholar
J. Li, K. Sun, B. Qi et al., “An evaluation of the effects and safety of Zuogui pill for treating osteoporosis: current evidence for an ancient Chinese herbal formula,” Phytotherapy Research, vol. 35, no. 4, pp. 1754–1767, 2020.
View at: Google Scholar
A. Qaseem, M. A. Forciea, R. M. McLean et al., “Treatment of low bone density or osteoporosis to prevent fractures in men and women: a clinical practice guideline update from the American College of Physicians,” Annals of Internal Medicine, vol. 166, no. 11, pp. 818–839, 2017.
View at: Publisher Site | Google Scholar
J. Burch, S. Rice, H. Yang et al., “Systematic review of the use of bone turnover markers for monitoring the response to osteoporosis treatment: the secondary prevention of fractures, and primary prevention of fractures in high-risk groups,” Health Technology Assessment, vol. 18, no. 11, pp. 1–180, 2014.
View at: Publisher Site | Google Scholar
S. Ishtiaq, I. Fogelman, and G. Hampson, “Treatment of post-menopausal osteoporosis: beyond bisphosphonates,” Journal of Endocrinological Investigation, vol. 38, no. 1, pp. 13–29, 2015.
View at: Publisher Site | Google Scholar
S. Dehghani, M. Hosseini, S. Haghgoo et al., “Multifunctional MIL-Cur@FC as a theranostic agent for magnetic resonance imaging and targeting drug delivery: in vitro and in vivo study,” Journal of Drug Targeting, vol. 28, no. 6, pp. 668–680, 2020.
View at: Publisher Site | Google Scholar
M. Heinrich, G. Appendino, T. Efferth et al., “Best practice in research - overcoming common challenges in phytopharmacological research,” Journal of Ethnopharmacology, vol. 246, 2020.
View at: Publisher Site | Google Scholar
C. Y. Huang, C. J. Cheng, W. F. Chiou, W. C. Chang, Y. N. Kang, and M. H. Lee, “Efficacy and safety of Duhuo Jisheng decoction add-on bisphosphonate medications in patients with osteoporosis: a meta-analysis of randomized controlled trials,” Journal of Ethnopharmacology, vol. 283, article 114732, 2021.
View at: Google Scholar
B. Chopra, A. K. Dhingra, and K. L. Dhar, “Psoralea corylifolia L. (Buguchi) -- folklore to modern evidence: review,” Fitoterapia, vol. 90, pp. 44–56, 2013.
View at: Publisher Site | Google Scholar
Y. Liu, X. M. Yuan, Y. N. Bi, Y. N. Gao, K. Zhou, and Y. Z. Li, “Treatment of psoralen on osteoporosis in rats induced by retinoic acid,” Laboratory Animal Science, vol. 35, no. 1, pp. 44–47, 2018.
View at: Google Scholar
J. H. Cao, J. H. Li, and L. B. Peng, “Study on the effective active ingredients and pharmacological effects of Fructus Psoraleae,” Contemporary Medicine, vol. 16, no. 15, pp. 16-17, 2010.
View at: Google Scholar
X. Yuan, Y. Bi, Z. Yan, W. Pu, Y. Li, and K. Zhou, “Psoralen and isopsoralen ameliorate sex hormone deficiency-induced osteoporosis in female and male mice,” BioMed research international, vol. 2016, Article ID 6869452, 2016.
View at: Google Scholar
Z. B. Weng, Q. Q. Gao, F. Wang et al., “Positive skeletal effect of two ingredients of Psoralea corylifolia L. on estrogen deficiency-induced osteoporosis and the possible mechanisms of action,” Molecular and Cellular Endocrinology, vol. 417, pp. 103–113, 2015.
View at: Publisher Site | Google Scholar
L. Chai, K. Zhou, S. Wang et al., “Psoralen and bakuchiol ameliorate M-CSF plus RANKL-induced osteoclast differentiation and bone resorption via inhibition of AKT and AP-1 pathways in vitro,” Cellular Physiology and Biochemistry, vol. 48, no. 5, pp. 2123–2133, 2018.
View at: Publisher Site | Google Scholar
J. van Luijk, M. Leenaars, C. Hooijmans, K. Wever, R. de Vries, and M. Ritskes-Hoitinga, “Towards evidence-based translational research: the pros and cons of conducting systematic reviews of animal studies,” ALTEX, vol. 30, no. 2, pp. 256-257, 2013.
View at: Publisher Site | Google Scholar
D. Moher, A. Liberati, J. Tetzlaff, D. G. Altman, and Prisma Group, “Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement,” PLoS Medicine, vol. 6, no. 7, article e1000097, 2009.
View at: Publisher Site | Google Scholar
M. R. Macleod, T. O'Collins, D. W. Howells, and G. A. Donnan, “Pooling of animal experimental data reveals influence of study design and publication bias,” Stroke, vol. 35, no. 5, pp. 1203–1208, 2004.
View at: Publisher Site | Google Scholar
G. H. Guyatt, A. D. Oxman, S. Sultan et al., “GRADE guidelines: 9. Rating up the quality of evidence,” Journal of Clinical Epidemiology, vol. 64, no. 12, pp. 1311–1316, 2011.
View at: Publisher Site | Google Scholar
H. Balshem, M. Helfand, H. J. Schünemann et al., “GRADE guidelines: 3. Rating the quality of evidence,” Journal of Clinical Epidemiology, vol. 64, no. 4, pp. 401–406, 2011.
View at: Publisher Site | Google Scholar
J. Wang, J. Wang, M. Lu, T. T. Mu, and Y. H. Geng, “Effects of isopsoralen on bone metabolism in rats through PPAR-γ-Axin2-Wnt signaling pathway,” World Chinese Medicine, vol. 16, no. 9, pp. 1413–1416, 2021.
View at: Google Scholar
Y. C. Shang, H. Y. Zhang, and W. W. Cai, “Exploration of the effect of isopsoralen on bone metabolism in osteoporotic rats,” Chinese Journal of Osteoporosis, vol. 27, no. 2, pp. 220–224, 2021.
View at: Google Scholar
L. H. Chen and H. Y. Tang, “Effect of psoralen on osteoporosis in postmenopausal rats and PI3K/Akt/mTOR signaling pathway,” China Pharmacy, vol. 32, no. 6, pp. 697–701, 2021.
View at: Google Scholar
Y. M. Zhou, J. N. Zhang, and Z. S. Shan, “Effects of psoralen corylifolia extract on bone mineral density and bone biomechanics in osteoporosis rats,” Chinese Journal of Tissue Engineering Research, vol. 24, no. 2, pp. 165–170, 2020.
View at: Google Scholar
B. J. Liu, X. X. Liu, Q. Ning et al., “Evaluation of toxicity and anti-osteoporosis effect in rats treated with the flavonoids of _Psoraleae Fructus_,” Journal of Functional Foods, vol. 75, p. 104262, 2020.
View at: Publisher Site | Google Scholar
J. Wang, J. Wang, M. Lu, T. T. Mu, and Y. H. Geng, “Effect and mechanism of isopsoralen on oxidative stress-mediated osteoporosis in rats,” Chinese Journal of Difficult and Complicated Cases, vol. 18, no. 9, pp. 940–944, 2019.
View at: Google Scholar
P. Y. Zhang, Z. X. Wang, X. M. Yuan, Y. N. Bi, Y. Zhang, and K. Zhou, “The effect of bakuchiol for the treatment of osteoporosis in ovariectomized female mice,” Laboratory Animal Science, vol. 36, no. 3, pp. 1–5, 2019.
View at: Google Scholar
R. Liu, X. Yang, X. Li, C. Zhang, and Q. M. Gao, “Effects of isopsoralen on bone metabolism in ovariectomized rats,” Chinese Journal of Osteoporosis, vol. 23, no. 6, pp. 807–811, 2017.
View at: Google Scholar
K. Huang and J. Zhou, “A study on the influence of psoralen on bone metabolism and biomechanics in ovariectomized mice,” Orthopaedic Biomechanics Materials and Clinical Study, vol. 14, no. 6, pp. 11–14, 2017.
View at: Google Scholar
J. Wang, T. Y. Chen, G. Wang, and R. L. T. Ge, “Differentiation of bone marrow mesenchymal stem cells in osteoblasts and adipocytes and its role in treatment of osteoporosis,” Chinese Journal of Osteoporosis, vol. 22, no. 8, pp. 226–233, 2016.
View at: Publisher Site | Google Scholar
H. Cai, Experimental study on single herb Rhizoma Drynariae, Psoralea Corylifolia and the bi-combined about prevention and treatment on bone loss in OVX rats, Anhui University of Chinese Medicine, 2015.
Z. B. Zhu, H. Shen, Z. B. Lin, X. L. Ding, and Y. H. Liu, “Experimental study on the effect of bavachin on osteoporosis in ovariectomized rats,” Shaanxi Journal of Traditional Chinese Medicine, vol. 36, no. 8, pp. 1083-1084, 2015.
View at: Google Scholar
J. Li, X. J. Wang, Y. Zeng et al., “Study on effect of psoralidin on anti-experimental postmenopausal osteoporosis and its mechanism,” China Journal of Chinese Materia Medica, vol. 38, no. 11, pp. 1816–1819, 2013.
View at: Google Scholar
Y. X. Cai and J. Y. Zhang, “Effects of Psoralea corylifolia L. on bone metabolism in ovariectomized osteoporotic rats,” Journal of Clinical Rehabilitative Tissue Engineering Research, vol. 13, no. 2, pp. 268–271, 2009.
View at: Google Scholar
S. H. Lim, T. Y. Ha, S. R. Kim, J. Ahn, H. J. Park, and S. Kim, “Ethanol extract of Psoralea corylifolia L. and its main constituent, bakuchiol, reduce bone loss in ovariectomised Sprague-Dawley rats,” The British Journal of Nutrition, vol. 101, no. 7, pp. 1031–1039, 2009.
View at: Publisher Site | Google Scholar
L. García-Bonilla, M. Campos, D. Giralt et al., “Evidence for the efficacy of statins in animal stroke models: a meta-analysis,” Journal of Neurochemistry, vol. 122, no. 2, pp. 233–243, 2012.
View at: Publisher Site | Google Scholar
D. Moher, M. Avey, G. Antes, and D. G. Altman, “Erratum: the National Institutes of Health and guidance for reporting preclinical research,” BMC Medicine, vol. 13, no. 1, p. 80, 2015.
View at: Publisher Site | Google Scholar
K. K. Gupta, J. P. Attri, A. Singh, H. Kaur, and G. Kaur, “Basic concepts for sample size calculation: critical step for any clinical trials!,” Saudi Journal of Anaesthesia, vol. 10, no. 3, pp. 328–331, 2016.
View at: Publisher Site | Google Scholar
M. Permuy, M. Lopez-Pena, F. Munoz, and A. Gonzalez-Cantalapiedra, “Rabbit as model for osteoporosis research,” Journal of Bone and Mineral Metabolism, vol. 37, no. 4, pp. 573–583, 2019.
View at: Publisher Site | Google Scholar
S. T. Rashid, H. J. Salacinski, G. Hamilton, and A. M. Seifalian, “The use of animal models in developing the discipline of cardiovascular tissue engineering: a review,” Biomaterials, vol. 25, no. 9, pp. 1627–1637, 2004.
View at: Publisher Site | Google Scholar
E. Martin-Monge, I. F. Tresguerres, L. Blanco, A. Khraisat, R. Rodríguez-Torres, and J. A. Tresguerres, “Validation of an osteoporotic animal model for dental implant analyses: an in vivo densitometric study in rabbits,” The International Journal of Oral & Maxillofacial Implants, vol. 26, no. 4, pp. 725–730, 2011.
View at: Google Scholar
D. Qin, H. Zhang, H. Zhang, T. Sun, H. Zhao, and W. H. Lee, “Anti-osteoporosis effects of osteoking via reducing reactive oxygen species,” Journal of Ethnopharmacology, vol. 244, p. 112045, 2019.
View at: Publisher Site | Google Scholar
N. Mathavan, M. J. Turunen, M. Tagil, and H. Isaksson, “Characterising bone material composition and structure in the ovariectomized (OVX) rat model of osteoporosis,” Calcified Tissue International, vol. 97, no. 2, pp. 134–144, 2015.
View at: Publisher Site | Google Scholar
D. G. Hackam and D. A. Redelmeier, “Translation of research evidence from animals to humans,” JAMA, vol. 296, no. 14, pp. 1731-1732, 2006.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2021 Zhou Lin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

403

Downloads

716

Citations