Guizhi Fuling Wan, a Traditional Chinese Herbal Formula, Sensitizes Cisplatin-Resistant Human Ovarian Cancer Cells through Inactivation of the PI3K/AKT/mTOR Pathway

Han, Li; Guo, Xiaojuan; Bian, Hua; Yang, Lei; Chen, Zhong; Zang, Wenhua; Yang, Jingke

doi:https://doi.org/10.1155/2016/4651949

Evidence-Based Complementary and Alternative Medicine

On this page

Abstract Introduction Materials and Methods Results Discussion Ethical Approval Disclosure Authors’ Contributions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2016 | Article ID 4651949 | https://doi.org/10.1155/2016/4651949

Guizhi Fuling Wan, a Traditional Chinese Herbal Formula, Sensitizes Cisplatin-Resistant Human Ovarian Cancer Cells through Inactivation of the PI3K/AKT/mTOR Pathway

Li Han,¹Xiaojuan Guo,¹Hua Bian,¹Lei Yang,¹Zhong Chen,²Wenhua Zang,¹and Jingke Yang³

Academic Editor: Youn C. Kim

Received12 Mar 2016

Accepted18 Apr 2016

Published18 May 2016

Abstract

The aim of the study was to explore the possible mechanisms that Guizhi Fuling Wan (GFW) enhances the sensitivity of the SKOV3/DDP ovarian cancer cells and the resistant xenograft tumours to cisplatin. Rat medicated sera containing GFW were prepared by administering GFW to rats, and the primary bioactive constituents of the sera were gallic acid, paeonol, and paeoniflorin analysed by HPLC/QqQ MS. Cell counting kit-8 analysis was shown that coincubation of the sera with cisplatin/paclitaxel enhanced significantly the cytotoxic effect of cisplatin or paclitaxel in SKOV3/DDP cells. The presence of the rat medicated sera containing GFW resulted in an increase in rhodamine 123 accumulation by flow cytometric assays and a decrease in the protein levels of P-gp, phosphorylation of AKT at Ser473, and mTOR in a dose-dependent manner in SKOV3/DDP cells by western blot analysis, but the sera had no effect on the protein levels of PI3K p110α and total AKT. The low dose of GFW enhanced the anticancer efficacy of cisplatin and paclitaxel treatment in resistant SKOV3/DDP xenograft tumours. GFW could sensitize cisplatin-resistant SKOV3/DDP cells by inhibiting the protein level and function of P-gp, which may be medicated through inactivation of the PI3K/AKT/mTOR pathway.

1. Introduction

Ovarian cancer (OC) is the most lethal of the gynaecological malignancies, largely due to the concealed pathogenesis of OC and advanced stage (FIGO stages III and IV) at diagnosis in most patients [1]. The standard of care in the initial chemotherapeutic management of advanced OC is the combination of a platinum agent (carboplatin or cisplatin) and a taxane agent (paclitaxel or docetaxel) given intravenously [2]. Most ovarian cancer patients will respond to initial chemotherapy, but the long-term survival remains poor as a result of recurrence and drug resistance, leading to a 5-year survival rate of 46% [3]. Stordal et al. demonstrated that the recurrence/drug resistance in OC patients treated with first-line platinum/taxane chemotherapy was related to the overexpression of P-glycoprotein (P-gp) [4]. Other studies have shown that the main mechanism of drug resistance was also due to P-gp expression in doxorubicin-, vincristine-, and paclitaxel-resistant OC cell lines [5] and in OC patients [6]. Because P-gp overexpression plays an important role in the recurrence or drug resistance in OC chemotherapy, it is a problem that should be solved quickly to identify P-gp inhibitors and then improve the chemotherapy sensitivity for OC patients.

Unfortunately, there are no agents currently available to “block” P-gp-mediated resistance in the clinic, although four generations of P-gp inhibitors have been developed, and most of them have shown considerable in vitro success. The failure may be attributed to nonspecific toxicity, adverse drug interaction, and numerous pharmacokinetic issues associated with the use of P-gp inhibitors in the conducted clinical trials [7]. Thus, novel P-gp inhibitors with proven efficacy and minimal toxicity and/or adverse effects are urgently required to overcome P-gp-mediated resistance in cancer chemotherapy.

Guizhi Fuling Wan (GFW; Gyejibokryeong-hwan in Korean and Keishi-bukuryo-gan in Japan) is a well-known traditional Chinese herbal formula, comprising the five herbs Ramulus Cinnamomi cassiae, Scierotium Poriae cocos, Radix Albus paeoniae Lactiflorae, Cortex Radicis moutan, and Semen Pruni persicae. GFW originally appeared in Essential Prescriptions from the Golden Cabinet (Jinkui Yaolue), a classic clinical book of traditional Chinese medicine (TCM), written by Zhang Zhongjing (150–219 AD) at the end of the Eastern Han Dynasty. GFW has been used extensively throughout Asia in the treatment of blood stasis, and it has been proven to be very safe and effective with fewer harmful side effects. Modern medical research has shown that GFW has various therapeutic effects on conditions such as inflammatory skin disorders [8], endometriosis [9], diabetes-mellitus-induced neuropathology [10], and atherosclerosis [11]. GFW capsules are currently being assessed for the efficacy, safety, and dose-response in the treatment of primary dysmenorrhea by the USA Food and Drug Administration (FDA) [12, 13]. In the recent years, it was reported that catechin, one of the chemical constituents of GFW, is a potent P-gp inhibitor [14]. Moreover, it was demonstrated that the main bioactive constituents of GFW in rat plasma include gallic acid, amygdalin, albiflorin, paeoniflorin, paeonol, cinnamic acid, dehydrotumulosic acid, tumulosic acid, and polyporic acid C [15, 16], while gallic acid, paeonol, and dehydrotumulosic acid were found to have a potent P-gp inhibition effect on multidrug resistance (MDR) cell lines [17–19], and paeoniflorin was found to modulate MDR of the human gastric cancer cell line SGC7901/vincristine (VCR) effectively at nontoxic concentrations via inhibiting the activation of NF-kappaB and subsequently downregulating its target genes MDR1, which encodes P-gp [20]. Therefore, accumulating studies have shown that GFW may be a formula demonstrating a P-gp inhibition effect, a finding that has not yet been reported elsewhere.

Recently, more and more researchers have come to realize that drug resistance is a complex phenomenon involving multiple mechanisms, including the activation of multiple signalling pathways. Growing evidence has suggested that the phosphatidylinositol 3-kinase (PI3K)/AKT/mammalian target of rapamycin (mTOR) pathway, wherein MDR1 and NF-kappaB are downstream factors of this pathway, is closely related to the occurrence of drug resistance in cancer [21–23]. It was also found that cisplatin resistance to OC was related to the PI3K/AKT/mTOR pathway [22]. However, the effect of GFW on the pathway has never been explored.

The aims of the present experiments were to investigate whether GFW has inhibitory effects on P-gp and to identify the underlying molecular mechanisms involving the PI3K/AKT/mTOR pathway in human MDR OC cell lines, SKOV3/DDP, and mouse xenograft model generated from SKOV3/DDP cells.

2. Materials and Methods

2.1. Plant Materials and Preparation of the GFW Extract

The five herbals forming GFW—that is, Ramulus Cinnamomi cassiae (Batch number 201409), Scierotium Poriae cocos (Batch number 201410), Radix Albus paeoniae Lactiflorae (Batch number 201410), Cortex Radicis moutan (Batch number 201409), and Semen Pruni persicae (Batch number 201408)—were purchased from the Zhang Zhongjing Pharmacy Chain-Like Limited Company (Nanyang, China). The origin of these herbals was taxonomically double confirmed by Professor Xianzhang Huang, a plant taxonomist from the Zhang Zhongjing College of Chinese Medicine, Nanyang Institute of Technology, where the voucher specimens were deposited.

GFW was prepared in accordance with the process as stated in the Chinese Pharmacopeia (2010 Edition) [24]. Briefly, Cortex Radicis moutan was submerged in water and submitted to water distillation (WD) for 1 h with a standard apparatus for extracting volatile oil. The dregs of Cortex Radicis moutan were put together with Ramulus Cinnamomi cassiae, Scierotium Poriae cocos, Radix Albus paeoniae Lactiflorae, and Semen Pruni persicae and then were extracted twice (60 min per time) by refluxing with 90% ethanol (EtOH). The EtOH extracts were combined, filtered, and evaporated under reduced pressure to the appropriate volume. The dregs of the five herbs were extracted subsequently twice (60 min per time) with water. The water extracts were combined, filtered, and evaporated under reduced pressure to the appropriate volume. The concentrated EtOH extract was next combined with the water extract and volatile oil uniformly, and the concentration was adjusted to 1.5 g/mL corresponding to the crude herbs. The mixed solution was used for animal studies and preparing the rat medicated sera.

2.2. Cell Culture

The human OC SKOV3 cell line and its cisplatin-resistant SKOV3/DDP cell line were obtained from the Chinese Academy of Medical Sciences and Peking Union Medical College. The cells were cultured in RPMI 1640 (Gibco BRL, Grand Island, NY, USA) supplemented with 10% (v/v) foetal bovine sera (FBS; Hyclone, Logan, UT, USA) at 37°C in a humidified atmosphere containing 5% CO₂. To maintain resistance, SKOV3/DDP cells were cultured in medium containing 1 μg/mL cisplatin (Qilu Pharmaceutical Co., Ltd., Shandong, China).

2.3. Preparation of Rat Medicated Sera

The rat medicated sera were prepared according to the published protocols [25]. Briefly, 60 Wistar female rats, aged between 6 and 8 weeks old and weighing 220~250 g, were randomly divided into four groups (15 rats per group): the control group was given normal saline by gavage, and low-dose (LD) GFW group, middle-dose (MD) GFW group, and high-dose (HD) GFW group were given the mixed GFW solution by gavage at dosages of 4 gkg⁻¹d⁻¹, 8 gkg⁻¹d⁻¹, and 16 gkg⁻¹d⁻¹, respectively. The animals were supplied by the Henan Experimental Animal Center (Zhengzhou, China) and maintained in an air-conditioned room with a controlled temperature of °C, a humidity level of 45% to 65%, and a 12-/12-hour light/dark cycle. After 5 days of administration, the rats were anaesthetized, and the blood was collected from the abdominal aorta and centrifuged. The collected sera were aliquoted into 1 mL Eppendorf tubes and preserved at −80°C for future use. This study was carried out in strict accordance with the recommendations in the Guide for the Care and Use of Laboratory Animals of the National Institutes of Health. The protocol was approved by the Committee on the Ethics of Animal Experiments of the Nanyang Institute of Technology (Permit number: 2014-L38). The whole surgery was performed under sodium pentobarbital anaesthesia, and all efforts were made to minimize suffering.

2.4. Bioactive Constituents of GFW Analysis by HPLC/QqQ MS

An aliquot of 100 μL of LD sera was pipetted into a 1.5 mL capped polypropylene tube, 400 μL of methanol was added, and the contents were mixed by vortexing for 30 s. After centrifuging at 12,000 ×g for 5 min, 400 μL of the supernatant was transferred to a 10 mL glass tube and evaporated to dryness under a steam of nitrogen at +50°C. The residue was redissolved with 100 μL of the mobile phase and briefly vortexed. After centrifuging at 13,000 ×g for 5 min at room temperature again, the supernatant was transferred into a glass autosampler vial and 20 μL aliquot of supernatant was injected into the HPLC/Q-TOF MS system. Gallic acid (catalogue #91215, Sigma-Aldrich, St. Louis, MO, USA), paeoniflorin (catalogue #P0038, Sigma-Aldrich), and paeonol (catalogue #H35803, Sigma-Aldrich) were separately prepared in 100 μL of blank sera to obtain concentrations of 20.0, 10.0, and 40.0 ng/mL, respectively. The spiked sera were prepared as mentioned above for the LD sera and were analysed by the same system.

The HPLC was a ThermoFisher ACCELA LC system. The mobile phase consists of a mixed aqueous solution of methanol-ammonium acetate (5 mM). The flow rate was set at 0.3 mL/min. The column temperature was maintained at 30°C. Detection was achieved using a ThermoFisher TSQ Quantum Ultra Triple-Quadrupole Mass Spectrometer with an electrospray ionization (ESI) interface in the negative-ion mode. The parameter settings were as follows: spray voltage, 2,000 V; capillary temperature, 400°C; sheath gas (nitrogen), 40 arbitrary units; auxiliary gas (nitrogen), 10 arbitrary units; vaporizer temperature, room temperature. Detection of the compounds was performed in the selected-ion monitoring (SIM) mode with 169.0 [M − H]⁻ for gallic acid, 479.4 [M − H]⁻ for paeoniflorin, and 167.0 [M − H]⁻ for paeonol. ThermoFisher LCQUAN software was used to analyse the chromatograms.

2.5. Cytotoxicity Assay

The ability of the rat medicated sera containing GFW to potentiate cisplatin or paclitaxel (Hisun Pharmaceutical Co., Ltd., Zhejiang, China) cytotoxicity was evaluated in SKOV3/DDP and SKOV3 cells using cell counting kit-8 (CCK-8) (Sigma-Aldrich, St. Louis, MO, USA) assay [26]. Briefly, the cells were harvested in the exponential growth phase and were seeded into 96-well plates at a density of cells per well. The supernatant was removed after the cells adhered to the wall, and then FBS-free RPMI 1640 medium was added followed by incubation for another 24 hours at 37°C. Additionally, the cells were treated with the rat medicated control sera, the LD, MD, and HD sera, the LD sera, or verapamil (VER, Harvest Pharmaceutical Co., Ltd., Shanghai, China; 5 μmol/L) plus cisplatin or paclitaxel. The sera volume ratio for incubation is 10%. After incubation at 37°C for 72 hours, WST-8 [2-(2-methoxy-4-nitrophenyl)-3-(4-nitrophenyl)-5-(2, 4-disulfophenyl)-2H tetrazolium, monosodium salt], which can be bioreduced by cellular dehydrogenases to an orange formazan product, which is then dissolved in cell culture medium, was added to the cells at a volume ratio of 1 : 10 to incubate for 2.5 hours. The optical density (OD) was measured at 450 nm using an enzyme immunoassay analyser (Dynatech MR4100, USA). Cell viability (% of control) was calculated as follows: and growth inhibition rate was calculated as follows: 1 − cell viability%. The concentrations required to inhibit growth by 50% (IC₅₀ values) were calculated from the cytotoxicity curves using Bliss’s method. The resistance fold values, used as the parameter for resistance, were calculated by dividing the IC₅₀ of SKOV3/DDP cells by the IC₅₀ of SKOV3 cells to cisplatin or paclitaxel or other combinations as above. The reversal fold values, used as the potency parameter for reversal, were calculated by dividing the IC₅₀ of cisplatin or paclitaxel alone by the IC₅₀ of cisplatin or paclitaxel in combination with the LD sera or VER.

2.6. Flow Cytometric Assay of Rhodamine 123 Cellular Accumulation

The assay to analyse the function of P-gp in SKOV3/DDP cells was carried out using a modified method as previously described [27]. Briefly, the cells were adjusted to a density of 2 × 10⁶/mL, resuspended in serum-free medium, and distributed as 0.5 mL aliquots into 1 mL Eppendorf tubes. The LD, MD, and HD sera, VER (5 μmol/L), and vehicle were added to the aliquoted samples, and the samples were incubated at 37°C for 24 h before rhodamine 123 (Rho123; Sigma-Aldrich, St. Louis, MO, USA) was added at a final concentration of 0.5 μg/mL. The tubes were incubated further at 37°C for 1 h, and then the samples were transferred to 4 mL flow cytometry tubes and washed twice with ice-cold phosphate-buffered saline (PBS) before being resuspended in 0.5 mL of PBS. Flow cytometry analysis was carried out to evaluate the mean fluorescence intensity (MFI) of Rho123 in SKOV3/DDP cell using the EPICS XL-MCL flow cytometer (Beckman Coulter, Fullerton, CA, USA). All analyses were performed in duplicate in at least three separate experiments. The data were analysed using Expo32 ADC software (Beckman Coulter, Fullerton, CA, USA).

2.7. Western Blotting Assay

Western blotting analyses of P-gp, PI3K, AKT, phospho-AKT (p-AKT), and mTOR proteins were performed using a slight modification of the method described previously [28]. Briefly, SKOV3/DDP cells were seeded into 6-well plates at a density of 2.0 × 10⁶ cells per well and were treated with the rat medicated control sera, the LD, MD, and HD sera for 72 h, and then the cells were lysed using RIPA lysis buffer (Beyotime Institute of Biotechnology, China). The protein concentrations were determined using the bicinchoninic acid assay (BCA; Santa Cruz Biotechnology, USA). A total of 40 μg of proteins was electrophoresed via sodium dodecyl sulphate polyacrylamide gel electrophoresis (SDS-PAGE) and transferred onto nitrocellulose membranes (Millipore, USA), which were then blocked with 5% skimmed milk powder for 1 hour at room temperature. The membranes were next incubated with rabbit polyclonal antibody to PI3K p110α (clone H-201, catalogue #sc-7174, 1 : 500 dilution; Santa Cruz Biotechnology), AKT (clone H-136, catalogue #sc-8312, 1 : 1000 dilution; Santa Cruz Biotechnology), p-AKT (Ser473, catalogue #sc-33437, 1 : 1000 dilution; Santa Cruz Biotechnology), mTOR (clone H-266, catalogue #sc-8319, 1 : 1000 dilution; Santa Cruz Biotechnology), or mouse monoclonal antibody to human P-gp (catalogue #sc-55510, 1 : 500 dilution; Santa Cruz Biotechnology) and β-actin (catalogue #sc-47778, 1 : 500 dilution; Santa Cruz Biotechnology) at 4°C overnight. Following primary antibody incubation, the membranes were washed with TBST, and goat anti-rabbit IRDye 800CW (926-32211, 1 : 5000 dilution) or goat anti-mouse IRDye 680LT secondary antibody (926-68020, 1 : 10000 dilution; Li-COR Biosciences, NE, USA) was added, respectively. After incubation at room temperature for 2 hours, the bands were detected using the Odyssey Infrared Fluorescent Western Blots Imaging System from Li-COR Bioscience (Lincoln, NE, USA). The optical density of each band was measured with a computer-assisted imaging analysis system (Quantity One, Bio-Rad, Hemel Hempstead, UK) and the relative protein levels were normalized to optical density of β-actin.

2.8. In Vivo Tumour Xenografts and Reversing Efficacy Test

The ability of GFW to potentiate the antitumour activity of cisplatin/paclitaxel was evaluated using the SKOV3/DDP xenografts as described previously [29]. Briefly, female BALB/c nude mice, aged between 3 and 4 weeks and weighing 20~22 g, were housed in standard microisolator conditions free of pathogens and used in accordance with the Animal Care and Use protocol approved by Nanyang Institute of Technology. Next, SKOV3/DDP cells were injected into the left flanks of each mouse selected for the experiment. When the tumours reached a diameter of circa 6 mm (approximately 116 mm³), the mice were randomly divided into different treatment groups comprising 10 mice in each group: a control group (normal saline administered orally and consecutively for 21 days), a single LD GFW group at dosage of 4 gkg⁻¹d⁻¹ administered orally for 21 days, a cisplatin (10 mg/kg administered intraperitoneally (i.p.) per 4 days) plus paclitaxel (15 mg/kg administered intravenously (i.v.) per 3 days) group, a combination of cisplatin, paclitaxel, and LD GFW group, and a combination of cisplatin, paclitaxel, and VER (5.0 mgkg⁻¹ administrated i.v. for 21 days) group. The animals were weighed, and the tumour length () and width () were measured every 4 days. The tumour volume () was calculated according to published article [30] as follows: . After the last treatment, tumours were resected and weighted. The percent of tumour growth inhibition was calculated by comparing the average tumour weights of the treated groups with those of the tumour-bearing control group. Tumour growth in saline treated control animals was taken to be at 100%.

2.9. Statistical Analysis

For all of the experiments, the data are presented as the mean ± SD. Tests for significant differences between the groups were performed using one-way ANOVA with multiple comparisons (Fisher’s pairwise comparisons) using SPSS 20.0. A minimum value of 0.05 was estimated as the significance level for all tests. Graphic representations were performed using GraphPad Prism version 6.01 for Windows.

3. Results

3.1. Bioactive Constituents in Rat Medicated Sera after the Administration of GFW

We investigated whether the 3 potent MDR inhibitors, gallic acid, paeonol, and paeoniflorin in GFW, would be present in rat medicated sera after the administration of GFW. The chromatograms of the blank sera, spiked sera samples, and rat medicated sera samples after the oral administration of GFW are shown in Figure 1. Blank sera samples were screened and found to be free of interference from endogenous components or other sources at the same mass transitions (Figure 1(a)); the retention times (RTs) for gallic acid, paeonol, and paeoniflorin standards (Figure 1(b)) in the spiked sera samples were the same as those detected for three bioactive constituents in the rat medicated sera (Figure 1(c)), indicating that the 3 potent MDR inhibitors were present in the rat medicated sera.

(a)

(b)

(c)

3.2. In Vitro Reversing Effects

The ability of the rat medicated sera containing GFW to reverse the resistance against SKOV3/DDP cells was investigated, and the LD sera were used to study the reversing effect because they have the lowest growth inhibition effect on SKOV3 and SKOV3/DDP cells (less than 5%, Figure 2). The resistance fold of SKOV3/DDP cells to cisplatin and paclitaxel was approximately 4.13 and 3.85 compared with that of the SKOV3 cells. In the drug-resistant SKOV3/DDP cells, coincubation of the LD sera or VER with cisplatin or paclitaxel enhanced significantly the cytotoxic effect of cisplatin or paclitaxel (, Table 1). However, there is no significant difference between the LD sera in combination with cisplatin or paclitaxel and VER in combination with cisplatin or paclitaxel, although the reversal fold of the former was lower than those of the latter. These results indicate that the LD sera have similar reversing effect with VER in vitro.

3.3. Flow Cytometric Assay of Rho123 Accumulation in SKOV3/DDP Cells

The rat medicated sera containing GFW corresponding to different oral dosages were examined in a short-term Rho123 accumulation assay for their P-gp inhibitory effect on SKOV3/DDP cells. The results are displayed in Figure 3. The presence of the rat medicated sera containing GFW resulted in an increase in Rho123 accumulation in a dose-dependent manner in SKOV3/DDP cells, manifesting as peaks moving far away from the vertical-axis, and the MFI increased with the dose of the rat medicated sera. The effect of increasing Rho123 accumulation by the LD sera was similar to that of VER, manifesting the MFIs between them have no significant difference (). These results suggest that P-gp function was inhibited by the rat medicated sera containing GFW. In these short-term experiments, no signs of toxicity or cell damage were observed directly in microscope after stained with trypan blue.

(a)

(b)

Figure 3

P-gp function changes in SKOV3/DDP cells after treatment for 24 h with verapamil or the rat medicated sera containing GFW corresponding to oral doses by flow cytometric analyses. (a) Representative flow cytometry overlay plot is shown. The P-gp inhibition effect increased along with the peaks moving far away from the vertical-axis. (b) Bar graph of mean fluorescence intensities (MFIs) of Rho123 in SKOV3/DDP cells with different treated groups. The results are the mean ± SD of 3 independent experiments. , ; NS, no difference. LD sera represent the rat medicated sera corresponding to the GFW dosage of 4 gkg⁻¹d⁻¹. MD sera represent the rat medicated sera corresponding to the GFW dosage of 8 gkg⁻¹d⁻¹. HD sera represent the rat medicated sera corresponding to the GFW dosage of 16 gkg⁻¹d⁻¹.

3.4. GFW Disrupts the PI3K/AKT/mTOR Signalling Pathway

We employed Western blotting to test whether the PI3K/AKT/mTOR signalling pathway was involved in the reversing effect of the rat medicated sera containing GFW. As shown in Figure 4, the levels of P-gp and p-AKT at Ser473 as well as the expression of mTOR, a known downstream target of AKT, in SKOV3/DDP cells, were increased significantly compared with those in SKOV3 cells (). After treated with the rat medicated sera containing GFW in SKOV3/DDP cells, the levels of P-gp, p-AKT, and mTOR were decreased in a dose-dependent manner (, ). Whereas the levels of PI3K p110α and total AKT in SKOV3/DDP cells were not different compared with those in SKOV3 cells (), no changes were observed after SKOV3/DDP cells were treated with the rat medicated sera (). These results indicated that the sera inhibited MDR in SKOV3/DDP cells possibly through the downregulation of P-gp expression and the involvement of the PI3K/AKT/mTOR signalling pathway.

(a)

(b)

Figure 4

Rat medicated sera containing GFW inhibit MDR involved in P-gp and the PI3K/AKT/mTOR signalling pathway by Western blotting analysis in SKOV3/DDP cells after treated for 72 h. (a) Representative Western blotting gel results. (b) Bar graphs for relative protein levels. The results are the mean ± SD of at least 3 independent experiments. -actin was used as an endogenous control and densitometric values were normalized by β-actin. , . LD sera represent the rat medicated sera corresponding to the GFW dosage of 4 g·kg⁻¹·d⁻¹. MD sera represent the rat medicated sera corresponding to the GFW dosage of 8 gkg⁻¹d⁻¹. HD sera represent the rat medicated sera corresponding to the GFW dosage of 16 gkg⁻¹d⁻¹.

3.5. In Vivo Efficacy Evaluation

The ability of GFW to reverse MDR in vivo was tested in BALB/c xenograft nude mice generated with SKOV3/DDP cells. Compared with mice treated with saline, mice treated with a single LD of GFW showed no reduction in tumour growth and no death was observed with 21 days of administration. A similar outcome was obtained by measuring the weight of the mice and excised tumours at the end of the administration (). However, 2/10 mice died in the saline treatment group at the end of the administration; this may result from progression of disease. These results suggest that LD GFW has no apparent antitumour effect and may own the property of low toxicity on tested animals.

The combination of cisplatin and paclitaxel showed tumour growth inhibition of 40.66% at the end of the administration in the resistant SKOV3/DDP xenograft tumours, and the average tumour volume was decreased significantly along with 21 days of administration, while 3/10 mice died, and the average weight of the mice was reduced significantly at the end of the administration compared with that in the mice treated with saline (); this may result from chemotherapeutic toxicities of cisplatin and paclitaxel. By contrast, no mice died, and the average weight of the mice showed no significant decrease at the end of the administration in the combination cisplatin, paclitaxel, and LD GFW group (); however, the tumour growth inhibition increased to 66.2% at the end of the administration compared with that in the mice treated with saline. In the meanwhile, a similar tumour growth inhibition effect was observed in the combinative treatment of cisplatin, paclitaxel, and VER group; however, also 4/10 mice died at the end of administration in this group (Figures 5(a), 5(b), and 5(c)). These in vivo findings demonstrated that LD GFW enhances the anticancer efficacy of cisplatin and paclitaxel treatment in resistant SKOV3/DDP xenograft tumours with mice body weights being maintained.

(a)

(b)

(c)

Figure 5

Inhibition of xenograft ovarian cancer by GFW. BALB/c nude mice bearing tumours formed by SKOV3/DDP cells were given saline as controls, a single GFW dosage of 4 gkg⁻¹d⁻¹(LD GFW), cisplatin (10 mg/kg administered intraperitoneally (i.p.) per 4 days) and paclitaxel (15 mg/kg administered i.v. per 3 days), combination of cisplatin, paclitaxel, and LD GFW, or combination of cisplatin, paclitaxel, and VER (5.0 mgkg⁻¹ administrated i.v. for 21 days) (). The figures show the average tumour volumes along with the days after different treatments (a), average excised tumour weights (b), and body weights (c) of mice at the end of observation. ; NS, no difference.

4. Discussion

In recent years, interest in the potential of plants and herbal medicine as a source of novel medicinal agents has grown significantly. Substantive research, aimed at utilizing this vast natural resource, is being carried out worldwide. In the development of anticancer agents, a wide range of plant-derived cytotoxic agents and/or MDR inhibitors were discovered from plant extracts. However, a large amount of time and effort is required before these agents can reach the market for clinical use due to insufficient evidence supporting their safety. For example, the development of camptothecins and taxanes as drugs for clinical use took over twenty years [31].

TCM has more than 2,000-year history of dealing with diseases and has evolved over time to become the second largest health care system in the world, after modern Western medicine. In general, treatment with Western medicine is not satisfactory for chronic diseases such as cardiovascular disease, type 2 diabetes mellitus, chronic pain, and cancer; TCM may offer an effective option [32, 33]. In addition, the long history of TCM use may dramatically reduce the time to its clinical use, if a TCM formula is found that has new therapeutic effects apart from its traditional usage. GFW is a TCM formula used in China, Japan, and other Asian countries that has been proven to be very safe and effective with fewer harmful side effects according to its long history of use. Recently, GFW was reported to improve the curative effect of chemotherapy with lower side effects when combined with cisplatin in OC patients during a 3-month treatment cycle, but the exact mechanism is unknown [34]. We suspect that enhancement of the effect may be involved in certain mechanisms delaying and/or overcoming MDR in chemotherapy. To address the possible mechanisms, a novel seropharmacology method arising recently for pharmacological study was adopted to study TCM in vitro using animal-medicated sera [35]. TCM formulas typically comprise more than 3 herbs, making their extracts contain hundreds or thousands of components; for example, GFW was found to contain 27 main components, including monoterpene glycosides, acetophenones, galloyl glucose, and even some isomers in its extract [36]. The essence of seropharmacology is to administer TCM to experimental animals (generally rabbits or rats), followed by harvesting the animal sera after a period of time. The sera are then applied to different cell lines for molecular mechanism studies. The advantage of seropharmacology for TCM study is the use of a TCM formula as a whole and the focus on the actual pharmaceutical ingredients or internal biological metabolic compounds of the formula, avoiding the isolation of individual components which may remove other potential key components that may not be detected using current technologies. We found that the 3 potent MDR inhibitors, gallic acid, paeonol, and paeoniflorin, in GFW extract were present in the rat medicated sera after the administration of GFW (Figure 1) by HPLC/QqQ MS technology.

The in vitro reversal effects of the rat medicated sera containing GFW were studied with first-line chemotherapeutical drugs for OC, cisplatin and paclitaxel, in SKOV3/DDP cells and its parental cisplatin-sensitive counterpart. We found that the sera containing GFW significantly restored the sensitivity of SKOV3/DDP cells to cisplatin and paclitaxel. However, in SKOV3 cells, the rat medicated sera containing GFW had no significant effect on drug cytotoxicity. Moreover, we showed that GFW could overcome the resistance of cisplatin and paclitaxel in xenograft tumour models generated with SKOV3/DDP cells (Figures 5(a) and 5(b)). The reversal effect of the rat medicated sera containing GFW was similar to those of the known MDR inhibitor, verapamil, which was popularly used as a positive control for research on inhibition of P-gp function [37, 38]. Since a median lethal dose of VER for the i.v. administration in mouse was reported to be 7.6 mgkg⁻¹ [39], a single i.v. dose of 2.5 mgkg⁻¹ VER still caused the death of 40% of animals in the in vivo efficacy test, which may result from the cardiotoxicity of VER [40]; instead, no mice died in the combinative treatment of cisplatin, paclitaxel, and LD of GFW group. These data suggest, for the first time, that GFW may be an efficacious reversal TCM formula for ovarian cancer in vitro and in vivo.

P-gp modulation is thought to be an effective strategy to reverse MDR by inhibiting P-gp function and/or expression [41], reducing the clearance of anticancer drugs by cancer cells and then dramatically increasing their toxicity. Rho123 has been used as a marker for detecting the changes in P-gp function due to its low toxicity and specificity for P-gp [42, 43]. Some authors have reported that Rho123 is a substrate for both MRP and P-gp [44], but it was also reported that Rho123 is transported approximately 10 times higher by P-gp than by MRP1, and it is useless for the test of MRP1 activity [45]. In this study, we demonstrated that Rho123 accumulation was increased in a dose-dependent manner after adding the rat medicated sera containing GFW in SKOV3/DDP cells, suggesting that GFW reverses MDR through the inhibiting of P-gp function.

The PI3K/AKT/mTOR pathway is crucial for the regulation of chemoresistance in various cancers [46]. Activated receptor tyrosine kinase (RTK) associates with the p85 SH2-domain-containing subunit and recruits and activates the p110 catalytic domain of PI3K. Activated PI3K phosphorylates membrane phosphatidylinositol-4,5-bisphosphate (PIP2) in the 30 position, which acts as a docking site for phosphoinositide-dependent kinase 1 (PDK1) and AKT. AKT is activated by PDK and regulates downstream effectors, such as MDR1, which regulates drug resistance [21, 47]. mTOR participates in cell survival and proliferation, in part, through its ability to control AKT activity by the phosphorylation of AKT at Ser473 [48]. The inhibition of AKT phosphorylation could significantly downregulate the expression of P-gp and thus partially reverse MDR [49]. Due to its mechanistic activity involving these crucial pathways that directly or indirectly interplay with P-gp activities, we posed a potent functional effect for GFW to affect such interaction. Our results demonstrated that the rat medicated sera containing GFW could inhibit the protein levels of P-gp, p-AKT at Ser473 and mTOR, which were significantly different between SKOV3/DDP cells and their parental cisplatin-sensitive counterpart, in a dose-dependent manner in SKOV3/DDP cells, while no effect has been shown on the protein levels of PI3K p110α and total AKT, which were not significantly different between SKOV3/DDP and their parental cisplatin-sensitive counterpart, suggesting that the effect of MDR reversal by GFW may occur through inhibition of the activated PI3K/AKT/mTOR signalling pathway.

In summary, this study demonstrates, for the first time, the reversal MDR potential of GFW for ovarian cancer in vitro and in vivo by inhibiting the protein expression and function of P-gp, which may act through the inactivation of the PI3K/AKT/mTOR signalling pathway. The combination of cisplatin and/or paclitaxel and GFW may provide a therapeutic benefit against cisplatin-resistant ovarian cancers after further validation.

Ethical Approval

The authors further confirm that any aspect of the work covered in this paper that has involved experimental animals has been conducted with the ethical approval of all relevant bodies and that such approvals are acknowledged within the paper.

Disclosure

The authors further confirm that the order of authors listed in the paper has been approved by all of them.

Competing Interests

The authors declare that they have no competing interests.

Authors’ Contributions

Li Han and Hua Bian conceived and designed the experiments. Li Han, Xiaojuan Guo, and Jingke Yang performed the experiments. Lei Yang analysed the data. Zhong Chen and Wenhua Zang contributed reagents, materials, and analysis tools. Li Han wrote the paper.

Acknowledgments

This work was supported by the Henan Province Foundation and Advanced Technology Research Program (Grant no. 152300410179).

References

D. Jelovac and D. K. Armstrong, “Recent progress in the diagnosis and treatment of ovarian cancer,” CA: A Cancer Journal for Clinicians, vol. 61, no. 3, pp. 183–203, 2011.
View at: Publisher Site | Google Scholar
B. T. Hennessy, R. L. Coleman, and M. Markman, “Ovarian cancer,” The Lancet, vol. 374, no. 9698, pp. 1371–1382, 2009.
View at: Publisher Site | Google Scholar
R. C. Bast Jr., “Molecular approaches to personalizing management of ovarian cancer,” Annals of Oncology, vol. 22, no. 8, pp. 5–15, 2011.
View at: Publisher Site | Google Scholar
B. Stordal, M. Hamon, V. McEneaney et al., “Resistance to paclitaxel in a cisplatin-resistant ovarian cancer cell line is mediated by P-glycoprotein,” PLoS ONE, vol. 7, no. 7, Article ID e40717, 2012.
View at: Publisher Site | Google Scholar
R. Januchowski, K. Wojtowicz, P. Sujka-Kordowska, M. Andrzejewska, and M. Zabel, “MDR gene expression analysis of six drug-resistant ovarian cancer cell lines,” BioMed Research International, vol. 2013, Article ID 241763, 2013.
View at: Publisher Site | Google Scholar
L. Xu, J. Cai, Q. Yang et al., “Prognostic significance of several biomarkers in epithelial ovarian cancer: a meta-analysis of published studies,” Journal of Cancer Research and Clinical Oncology, vol. 139, no. 8, pp. 1257–1277, 2013.
View at: Publisher Site | Google Scholar
Z. Binkhathlan and A. Lavasanifar, “P-glycoprotein inhibition as a therapeutic approach for overcoming multidrug resistance in cancer: current status and future perspectives,” Current Cancer Drug Targets, vol. 13, no. 3, pp. 326–346, 2013.
View at: Publisher Site | Google Scholar
S.-J. Jeong, H.-S. Lim, C.-S. Seo et al., “Anti-inflammatory actions of herbal formula Gyejibokryeong-hwan regulated by inhibiting chemokine production and STAT1 activation in HaCaT cells,” Biological & Pharmaceutical Bulletin, vol. 38, no. 3, pp. 425–434, 2015.
View at: Publisher Site | Google Scholar
C. Hu, Z. Wang, Z. Pang et al., “Guizhi fuling capsule, an ancient Chinese formula, attenuates endometriosis in rats via induction of apoptosis,” Climacteric, vol. 17, no. 4, pp. 410–416, 2014.
View at: Publisher Site | Google Scholar
K.-J. Wu, Y.-F. Chen, H.-Y. Tsai, C.-R. Wu, and W. G. Wood, “Guizhi-Fuling-Wan, a traditional Chinese herbal medicine, ameliorates memory deficits and neuronal apoptosis in the streptozotocin-induced hyperglycemic rodents via the decrease of bax/bcl2 ratio and caspase-3 expression,” Evidence-Based Complementary and Alternative Medicine, vol. 2012, Article ID 656150, 2012.
View at: Publisher Site | Google Scholar
Y. Nagata, H. Goto, H. Hikiami et al., “Effect of keishibukuryogan on endothelial function in patients with at least one component of the diagnostic criteria for metabolic syndrome: a controlled clinical trial with crossover design,” Evidence-Based Complementary and Alternative Medicine, vol. 2012, Article ID 359282, 10 pages, 2012.
View at: Publisher Site | Google Scholar
ClinicalTrials, ClinicalTrials.gov. Effect of KYG0395 on primary dysmenorrhea, https://clinicaltrials.gov/ct2/show/study/NCT01588236?term=KYG0395&rank=1.
X. Lei, J. Chen, C.-X. Liu, J. Lin, J. Lou, and H.-C. Shang, “Status and thoughts of Chinese patent medicines seeking approval in the US market,” Chinese Journal of Integrative Medicine, vol. 20, no. 6, pp. 403–408, 2014.
View at: Publisher Site | Google Scholar
S. Y. Eid, M. Z. El-Readi, E. E. M. N. Eldin, S. H. Fatani, and M. Wink, “Influence of combinations of digitonin with selected phenolics, terpenoids, and alkaloids on the expression and activity of P-glycoprotein in leukaemia and colon cancer cells,” Phytomedicine, vol. 21, no. 1, pp. 47–61, 2013.
View at: Publisher Site | Google Scholar
F. Xiao, Q. Li, K. Liang et al., “Comparative pharmacokinetics of three triterpene acids in rat plasma after oral administration of Poria extract and its formulated herbal preparation: GuiZhi-FuLing capsule,” Fitoterapia, vol. 83, no. 1, pp. 117–124, 2012.
View at: Publisher Site | Google Scholar
L. Zhao, Z. Xiong, Y. Sui et al., “Simultaneous determination of six bioactive constituents of Guizhi Fuling Capsule in rat plasma by UHPLC-MS/MS: application to a pharmacokinetic study,” Journal of Chromatography B: Analytical Technologies in the Biomedical and Life Sciences, vol. 1001, pp. 49–57, 2015.
View at: Publisher Site | Google Scholar
J. Cai, S. Chen, W. Zhang et al., “Paeonol reverses paclitaxel resistance in human breast cancer cells by regulating the expression of transgelin 2,” Phytomedicine, vol. 21, no. 7, pp. 984–991, 2014.
View at: Publisher Site | Google Scholar
E. Chieli, N. Romiti, I. Rodeiro, and G. Garrido, “In vitro modulation of ABCB1/P-glycoprotein expression by polyphenols from Mangifera indica,” Chemico-Biological Interactions, vol. 186, no. 3, pp. 287–294, 2010.
View at: Publisher Site | Google Scholar
H. E. Shan, Z. Qing-lin, L. U. Yu-xin, C. Xiao-chen, and H. Yuan, “Isolation and identification of ethanolic extract of Poria cocos and its reversal of multidrug resistance of KBV200 cells,” International Journal of Pharmaceutical Research, vol. 39, no. 1, pp. 49–55, 2012.
View at: Google Scholar
S. Fang, W. Zhu, Y. Zhang, Y. Shu, and P. Liu, “Paeoniflorin modulates multidrug resistance of a human gastric cancer cell line via the inhibition of NF-κB activation,” Molecular Medicine Reports, vol. 5, no. 2, pp. 351–356, 2012.
View at: Publisher Site | Google Scholar
H. A. Burris III, “Overcoming acquired resistance to anticancer therapy: Focus on the PI3K/AKT/mTOR pathway,” Cancer Chemotherapy and Pharmacology, vol. 71, no. 4, pp. 829–842, 2013.
View at: Publisher Site | Google Scholar
M. Liu, Z. Qi, B. Liu et al., “RY-2f, an isoflavone analog, overcomes cisplatin resistance to inhibit ovarian tumorigenesis via targeting the PI3K/AKT/mTOR signaling pathway,” Oncotarget, vol. 6, no. 28, pp. 25281–25294, 2015.
View at: Publisher Site | Google Scholar
S. T. Wilks, “Potential of overcoming resistance to HER2-targeted therapies through the PI3K/Akt/mTOR pathway,” The Breast, vol. 24, no. 5, pp. 548–555, 2015.
View at: Google Scholar
National Commission of Chinese Pharmacopoeia, Pharmacopoeia of Peoples Republic of China, vol. 1, China Medical Science and Technology Press, Beijing, China, 2010.
X. Hu, H. Lu, Y.-L. Deng, Q. Wan, and S.-M. Yie, “Effect of rat medicated serum containing Zuo Gui wan and/or you Gui Wan on the differentiation of stem cells derived from human first trimester umbilical cord into oocyte-like cells in vitro,” Evidence-Based Complementary and Alternative Medicine, vol. 2015, Article ID 825805, 17 pages, 2015.
View at: Publisher Site | Google Scholar
G. Liu, P. Du, and Z. Zhang, “Myeloid differentiation factor 88 promotes cisplatin chemoresistance in ovarian cancer,” Cell Biochemistry and Biophysics, vol. 71, no. 2, pp. 963–969, 2015.
View at: Publisher Site | Google Scholar
L. Han, Y. F. Wang, Y. Zhang et al., “Increased expression and function of P-glycoprotein in peripheral blood CD56+ cells is associated with the chemoresistance of non-small-cell lung cancer,” Cancer Chemotherapy and Pharmacology, vol. 70, no. 3, pp. 365–372, 2012.
View at: Publisher Site | Google Scholar
L. Han, Y. Wang, X. Guo et al., “Downregulation of MDR1 gene by cepharanthine hydrochloride is related to the activation of c-Jun/JNK in K562/ADR cells,” BioMed Research International, vol. 2014, Article ID 164391, 2014.
View at: Publisher Site | Google Scholar
N. Gyémánt, H. Engi, Z. Schelz et al., “In vitro and in vivo multidrug resistance reversal activity by a Betti-base derivative of tylosin,” British Journal of Cancer, vol. 103, no. 2, pp. 178–185, 2010.
View at: Publisher Site | Google Scholar
H. Li, Z. Yan, W. Ning et al., “Using rhodamine 123 accumulation in CD8⁺ cells as a surrogate indicator to study the P-glycoprotein modulating effect of cepharanthine hydrochloride in vivo,” Journal of Biomedicine and Biotechnology, vol. 2011, Article ID 281651, 7 pages, 2011.
View at: Publisher Site | Google Scholar
G. M. Cragg and D. J. Newman, “Plants as a source of anti-cancer agents,” Journal of Ethnopharmacology, vol. 100, no. 1-2, pp. 72–79, 2005.
View at: Publisher Site | Google Scholar
J.-J. Zhang, Q. Meng, W. Chang, and C.-H. Wan, “Clinical assessment of the efficacy of anti-cancer treatment: current status and perspectives,” Chinese Journal of Cancer, vol. 29, no. 2, pp. 234–238, 2010.
View at: Publisher Site | Google Scholar
X. Mao, X. Q. Zhang, and N. Lin, “Application and perspectives of traditional Chinese medicine in the treatment of liver cancer,” Cancer Translational Medicine, vol. 1, no. 3, pp. 101–107, 2015.
View at: Google Scholar
T. Min, “Clinical observation on the treatment of 28 cases of oophoroma with Guizhifuling pills and adjuvant chemotherapy,” Anti-Tumor Pharmacy, vol. 1, no. 6, pp. 520–523, 2011.
View at: Google Scholar
H. Xu, Q. Wu, C. Peng, and L. Zhou, “Study on the antiviral activity of San Huang Yi Gan Capsule against hepatitis B virus with seropharmacological method,” BMC Complementary and Alternative Medicine, vol. 13, article 239, 2013.
View at: Publisher Site | Google Scholar
L. Chen, D. Wang, J. Wu, B. Yu, and D. Zhu, “Identification of multiple constituents in the traditional Chinese medicine formula GuiZhiFuLing-Wan by HPLC-DAD-MS/MS,” Journal of Pharmaceutical and Biomedical Analysis, vol. 49, no. 2, pp. 267–275, 2009.
View at: Publisher Site | Google Scholar
T. Tsuruo, H. Iida, S. Tsukagoshi, and Y. Sakurai, “Overcoming of vincristine resistance in P388 leukemia in vivo and in vitro through enhanced cytotoxicity of vincristine and vinblastine by verapamil,” Cancer Research, vol. 41, no. 5, pp. 1967–1972, 1981.
View at: Google Scholar
W. Kishimoto, N. Ishiguro, E. Ludwig-Schwellinger, T. Ebner, K. Maeda, and Y. Sugiyama, “Usefulness of a model-based approach for estimating in vitro P-glycoprotein inhibition potency in a transcellular transport assay,” Journal of Pharmaceutical Sciences, vol. 105, no. 2, pp. 891–896, 2016.
View at: Publisher Site | Google Scholar
M. J. O'Neil, The Merck Index: An Encyclopedia of Chemicals, Drugs, and Biologicals, Merck and Co, Whitehouse Station, NJ, USA, 2006.
P. P. Jadhav and S. Bohra, “Cardiotoxicity of verapamil in renal failure: a case report and review of the literature,” Cases Journal, vol. 2, no. 9, article 6312, 2009.
View at: Publisher Site | Google Scholar
R. Callaghan, F. Luk, and M. Bebawy, “Inhibition of the multidrug resistance P-glycoprotein: time for a change of strategy?” Drug Metabolism and Disposition, vol. 42, no. 4, pp. 623–631, 2014.
View at: Publisher Site | Google Scholar
L. Han, X. Guo, H. Bian, Y. Zhou, T. Li, and J. Yang, “Changed expression and function of P-gp in peripheral blood CD56⁺ cells predicting chemoresistance in non-Hodgkin lymphoma patients,” Cancer Biomarkers, vol. 15, no. 3, pp. 289–297, 2015.
View at: Publisher Site | Google Scholar
J. Kasaian, F. Mosaffa, J. Behravan et al., “Reversal of P-glycoprotein-mediated multidrug resistance in MCF-7/Adr cancer cells by sesquiterpene coumarins,” Fitoterapia, vol. 103, pp. 149–154, 2015.
View at: Publisher Site | Google Scholar
R. Daoud, C. Kast, P. Gros, and E. Georges, “Rhodamine 123 binds to multiple sites in the multidrug resistance protein (MRP1),” Biochemistry, vol. 39, no. 50, pp. 15344–15352, 2000.
View at: Publisher Site | Google Scholar
A. L. Dogan, O. Legrand, A.-M. Faussat, J.-Y. Perrot, and J.-P. Marie, “Evaluation and comparison of MRP1 activity with three fluorescent dyes and three modulators in leukemic cell lines,” Leukemia Research, vol. 28, no. 6, pp. 619–622, 2004.
View at: Publisher Site | Google Scholar
S. T. Wilks, “Potential of overcoming resistance to HER2-targeted therapies through the PI3K/Akt/mTOR pathway,” The Breast, vol. 24, no. 5, pp. 548–555, 2015.
View at: Publisher Site | Google Scholar
P. L. Tazzari, A. Cappellini, F. Ricci et al., “Multidrug resistance-associated protein 1 expression is under the control of the phosphoinositide 3 kinase/Akt signal transduction network in human acute myelogenous leukemia blasts,” Leukemia, vol. 21, no. 3, pp. 427–438, 2007.
View at: Publisher Site | Google Scholar
A. Riaz, K. S. Zeller, and S. Johansson, “Receptor-specific mechanisms regulate phosphorylation of AKT at ser473: role of RICTOR in β1 integrin-mediated cell survival,” PLoS ONE, vol. 7, no. 2, article e32081, 2012.
View at: Publisher Site | Google Scholar
M. B. Aldonza, J. Y. Hong, S. Y. Bae et al., “Suppression of MAPK signaling and reversal of mTOR-dependent MDR1-associated multidrug resistance by 21alpha-methylmelianodiol in lung cancer cells,” PloS ONE, vol. 10, no. 6, Article ID e0127841, 2015.
View at: Google Scholar

Copyright

Copyright © 2016 Li Han et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

5765

Downloads

1221

Citations