Disease Markers

Disease Markers / 2018 / Article

Review Article | Open Access

Volume 2018 |Article ID 8309015 | https://doi.org/10.1155/2018/8309015

Shree Ram Lamichhane, Thanuja Thachil, Paolo De Ieso, Harriet Gee, Simon Andrew Moss, Natalie Milic, "Prognostic Role of MicroRNAs in Human Non-Small-Cell Lung Cancer: A Systematic Review and Meta-Analysis", Disease Markers, vol. 2018, Article ID 8309015, 17 pages, 2018. https://doi.org/10.1155/2018/8309015

Prognostic Role of MicroRNAs in Human Non-Small-Cell Lung Cancer: A Systematic Review and Meta-Analysis

Academic Editor: Marco Tomasetti
Received08 Jun 2018
Accepted27 Aug 2018
Published21 Oct 2018

Abstract

Background. MicroRNAs (miRNAs) have been found to play an important role in the development and outcomes for multiple human cancers. Their role as a prognostic biomarker in non-small-cell lung cancer (NSCLC) remains unclear. This meta-analysis aims to clarify the role of various miRNAs in the survival of NSCLC patients. Materials and Methods. All studies were identified through medical database search engines. A meta-analysis was conducted to assess the correlation between miRNAs expressions and overall survival among those NSCLC studies. Relevant data were extracted from each eligible study regarding baseline characteristics and key statistics such as hazard ratio (HR), 95% confidence interval (CI), and value, which were utilized to calculate a pooled effect size. Result. Thirty-two studies were included in the meta-analysis. Using a random effect model, the combined HR and 95% CI for overall survival (OS) was calculated as 1.59 (1.39–1.82), predicting a poor overall survival. Five miRNAs (miR-21, miR-155, miR-let-7, miR-148a, and miR-148b) were found to be of significance for predicting OS in at least two studies, hence, selected for subgroup analysis. Subgroup analysis disclosed that elevated levels of miR-21 and miR-155 in both cancer tissue and blood samples were associated with worse OS. Compared to American studies (I-squared: <0.001% and value: 0.94), Asian and European studies exhibited greater heterogeneity in miRNA expression and relationship to OS (I-squared, values were approximately 78.85%, <0.001 and 61.28%, 0.006, respectively). These subgroup analyses also highlighted that elevated expression of miR-21 and miR-155 and low levels of expression of miR-148a, miR-148b, and miR-let-7 were associated with poor prognosis in NSCLC. Conclusion. miR-21, miR-155, miR-148a, miR-148b, and miR-let-7 are consistently up- or downregulated in NSCLC and are associated with poor OS. These miRNAs show potential as useful prognostic biomarkers in the diagnosis, treatment, and follow-up of NSCLC.

1. Introduction

Lung cancer is the most common cause of death from cancer worldwide with a bleak overall 5-year survival rate of less than 15% for all-comers [1]. For treatment purposes, lung cancer is divided into two major subgroups, small cell (SCLC) and non-small-cell lung cancer (NSCLC). NSCLC accounts for approximately 80% of all lung cancers and is further divided into three major histological subtypes, which are adenocarcinoma, squamous cell carcinoma, and large-cell carcinoma [1, 2]. NSCLC is often diagnosed at an advanced stage when the prognosis is poor, resulting in low survival rates despite recent improvements in treatments [3]. Detection of accurate biomarkers can prognosticate cancer correctly with an aim to improve overall survival (OS). There is increasing evidence to suggest that micro-ribonucleic acids (miRNAs) play a critical role in the development of NSCLC and have been proposed as potential biomarkers for NSCLC prognosis and response to therapy [3, 4].

miRNAs are small (~22 nucleotides) noncoding RNAs that regulate more than half of the genes in human cells and are associated with various biological activities including cell proliferation, cell differentiation, cell migration, disease initiation, disease progression, and apoptosis [5]. miRNAs modulate gene activity at the posttranscriptional level by degrading or inhibiting the translation of their messenger RNA (mRNA) targets. It has been observed that miRNAs expression is frequently upregulated for oncogenic miRNA and downregulated for tumor suppressor miRNA [6].

Many investigators have carried out miRNA profiling studies in NSCLC with cell lines, paired tissue samples, and blood samples. Microarray-based miRNA profiling assays are robust methods of screening hundreds of miRNAs. Given a large number of potential candidate miRNAs, well-established miRNA signatures documented in the literature have been identified [4, 711]. In collating the results and verifying miRNA profile platforms, a major challenge is normalization and determining significant thresholds.

A pooled analysis of multiple miRNA expression profile studies for NSCLC patients was performed to explore the association between miRNA expressions and OS. The starting point of this meta-analysis was to collect various published miRNA profiling studies comparing microRNA expressions in NSCLC patients and correlating high expression levels compared to low expression profiles against OS. By extracting summary statistics from these studies for survival endpoints, we analysed the predictive value of miRNA-148a (miR-148a), miRNA-148b (miR-148b), miRNA-let-7 (Let-7), miRNA-21 (miR-21), and miRNA-155 (miR-155) for NSCLC prognosis.

2. Materials and Methods

This meta-analysis was performed following the guidelines of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement [12].

2.1. Search Strategy

The scientific literature published from January 2004 to March 2017 was interrogated using 5 different search engines: Scopus, PubMed, Science Direct, Web of Science, and Medline using key search words, including “microRNA expression or miRNA expression,” “lung cancer or NSCLC,” “prognosis,” “radiotherapy,” “radioresistance,” “radiosensitivity,” and “Human” (Supplementary Table 1). A manual review of references from published articles was also performed to select some additional studies.

2.2. Study Selection

PubMed search engine was selected as it provided the most relevant literature search for this topic. We reviewed all titles, including abstracts and full texts and ensured adherence to the inclusion and exclusion criteria for the meta-analysis. The primary literature that contained expression profiles of various miRNAs with multivariate analysis (high vs. low) and information including OS, HRs, 95% CIs, and values were included in this meta-analysis. Moreover, included studies were also required to report on clinicopathological and demographic data associated with the patient’s samples. Studies were excluded if they did not describe the association between miRNA expression and OS. Articles without full text or written in a language other than English were also excluded. Any doubt or uncertainty regarding the quality and inclusion of a piece of research work was resolved with the consensus of two clinical oncologists.

2.3. Quality Assessment

Two reviewers critically assessed the quality of all the studies included in this meta-analysis. All the studies were categorised into three groups: “unsatisfactory,” “satisfactory,” and “good” quality. The cut-off score was designed so that each study needed to be above “satisfactory” as described in Table 1.


CriteriaUnsatisfactorySatisfactoryGood

Sample sizeLess than ten samples10–100 samples>100 samples
Cox regression analysisOnly value is givenOnly multivariate analysis with HR, CI, and valueBoth univariate and multivariate analysis
SurvivalOnly DFSOS, DFSOS, DFS, RFS
miRNAs regulationNo significant upregulation or downregulationAt least one miRNA upregulated or downregulated>1 miRNA upregulated or downregulated
Total studies01215

DFS: disease-free survival; OS: overall survival; RFS: recurrence-free survival; HR: hazard ratio; CI: confidence interval; miRNA: microRNA.
2.4. Data Extraction

We independently extracted the required information from all eligible studies for meta-analysis. Prespecified data parameters included: (1)Demographic data regarding population, ethnicity, and survival rates during follow-up(2)Tumor data (histology, stage, primary lesions, and lymphoid node invasion)(3)Experimental data involving study design, materials, assays, and dysregulation of miRNAs expression(4)Statistical data including HRs for OS, 95% CI, and value(5)Publication data (author’s name, publication year, and journal title)

2.5. Statistical Analysis

HRs and 95% CIs extracted from the graphical survival plots from eligible articles were combined for the OS results. Forest plots were used to illustrate the association of miRNAs expression and OS. Heterogeneity was assessed using the Cochran Q test and Higgins I-squared statistic. value less than 0.05 () and I-squared value greater than 50% (I-square > 50%) indicated the presence of significant heterogeneity across studies. The random effect model was applied in the presence of heterogeneity between studies. An observed HR > 1 indicated a worse OS and poor prognosis in the group with elevated or reduced miRNA expressions. Publication bias was evaluated with the inverted funnel plot and the Egger’s and Begg’s bias indicator test. All the values were two-sided, with value less than 0.05 () considered statistically significant. All calculations were performed using Comprehensive Meta-Analysis Version 3.0 software (Biostat, USA).

3. Results

3.1. Literature Search and Study Characteristics

A preliminary online PubMed search highlighted a total of 578 studies concerning miRNA expression and lung cancer prognosis. An additional 26 studies were included from references and citations within the primary highlighted articles. Total 559 records were excluded as they represented irrelevant studies to the current analysis, review articles, letters, and in vitro/in vivo studies. Based on the readings of the article titles and abstracts and according to the inclusion and exclusion criteria, 45 articles were selected for more detailed evaluation. An additional 18 articles were excluded as they lacked key statistics in which eight articles did not mention HR or 95% CI values, whereas ten articles did not report on OS of the selected miRNAs. Finally, a total of 27 articles consisting of 32 independent studies were included in the meta-analysis. A flow chart of the study selection process is shown in Figure 1. Three articles [1315] included two independent cohorts each, whereas one article [16] included three independent cohorts.

The data from the 32 studies included in the meta-analysis is summarized in Table 2. There was a total of 5553 samples from all of the studies, which was sorted according to country: United States (1439), Europe (662), and Asia (3452). Most Asian patient samples were from China (81.55%). Twenty-eight retrospective studies included tissue samples while four prospective studies used liquid biopsy samples [13, 17, 18]. miRNA expression levels were predominantly studied in paired tumor tissues, i.e., cancer tissue and adjacent benign tissue (20 out of 28 studies) as eight tissue sample studies made no mention if patient samples were paired tissue samples or single tumor biopsies. Among all 28 tissue sample studies, 12 studies included all tumor subtypes, whereas eight studies included only adenocarcinoma, four studies included only squamous cell carcinoma, and four studies [13, 1921] did not differentiate the tumor subtype.


StudyPopulationStudy periodSample number (patient/control)Source of miRNAmiRNA expressedCancer type/subtypeHistological stagemiRNA analysis platformFollow-up

Chen et al., 2017 [22]ChinaJul 2004–Jun 2009165/165Tissue (FFPE)miR-148aSCC: 45.5%; AC: 54.5%T1 = 34; T2 = 89; T3 = 41; U = 1ISH5 yrs
Liu et al., 2017 [52]China2003–200587Tissue (FFPE)miR-29cACT1 = 10; T2 = 62; T3 = 15miRNA array/qRT-PCR5 yrs
Chen et al., 2016 [23]ChinaJan 2010–Jun 2012134Tissue (FFPE)miR-200aSCC: 41.8%; AC: 48.5%; ASC: 5.2%; LCC: 4.5%T1 = 34; T2: 26; T3a: 74ISH28 months (1–58)
Wang et al., 2016 [34]ChinaJan 2014–May 201539/39TissuemiR-148bSCC: 38.5%; AC: 61.5%T1 = 12; T2, T3 & T4 = 27qRT-PCR(2–60) months
Shang et al., 2016 [53]ChinaJun 2009–Sept 2010139/139TissuemiR-383SCC: 59%; AC: 41%T1 & T2 = 63; T3 = 76qRT-PCR60 months
Chen et al., 2015 [50]ChinaMar 2007–Apr 2013137/137TissuemiR-153SCC: 49.6%; AC: 50.4%T1 & T2 = 104; T3 & T4 = 33qRT-PCR5 yrs
Ge et al., 2015 [35]ChinaMay 2007–Apr 2012151/151TissuemiR-148bSCC: 46.4%; AC: 43.7%T1 & T2 = 91; T3 & T4 = 60qRT-PCRN/A
Skrzypski et al., 2014 [30]Poland2001–2012134TissuemiR-662/miR-192/miR-192SCCT1a = 29; T1b = 65; T2a = 4 & T2b = 31 & T3a = 5miRNA array/qRT-PCR5.8 yrs (4.1–10.0)
Yu et al., 2014 [13]ChinaMay 2008–Jul 2010164/164SerummiR-375SCC: 26.8%, AC: 60.98%, Others: 12.2%T1 = 3; T2 = 42; T3 = 58; T4 = 34qRT-PCR24 months (0–56)
53/53SerummiR-375N/AN/AqRT-PCR24 months (0–56)
Xiao-chun et al., 2013 [19]China2001–200760/60TissuemiR-21NSCLCT1 & T2 = 29; T3 & T4 = 31qRT-PCRN/A
Sanfiorenzo et al., 2013 [17]FranceMar 2008–Mar 201052/20PlasmamiR-155SCC: 48%; AC: 52%T1a = 8; T1b = 14; T2a = 5; T2b = 8; T3a = 7qRT-PCRN/A
Chen et al., 2013 [33]ChinaFeb 2008–Dec 200947Tissue (FFPE)miR-148aSCC: 52.1%; AC: 47.9%T1 = 25; T2 & T3 = 23qRT-PCRN/A
Jang et al., 2012 [14]USAJan 1997–Sep 200856/56Tissue (FF)miR-708ACN/AmiRNA array/qRT-PCRN/A
47/47Tissue (FFPE)miR-708ACN/AmiRNA array/qRT-PCRN/A
Liu et al., 2012 [24]China2003–200570/70TissuemiR-21ACT1 = 10; T2 = 62; T3 = 15miRNA array/qRT-PCR2 yrs
Li et al., 2012 [51]ChinaJan 2006–Dec 200796/96TissuemiR-375SCC: 43.75%; AC: 56.25%T1 or T2 = 66; T3 = 30qRT-PCR30 months (8–69)
Tan et al., 2011 [31]China2000–200260/60TissuemiR-31NSCLCT1 = 21; T2 = 17 & T3 = 22miRNA array/qRT-PCRN/A
Donnem et al., 2011 [15]Norway1990–2004191Tissue (SCC)miR-155SCCN/AISH86 months (48–216)
95Tissue (AC)miR-155ACN/AISH86 months (48–216)
Saito et al., 2011 [16]USA1987–200989/89TissuemiR-21/miR-155ACT1 = 57; t2 = 22; T3 = 10qRT-PCR5 yrs
Norway1988–200337/37TissuemiR-21/miR-155ACT1 = 21; T2 = 5; T3 = 11qRT-PCR5 yrs
Japan1998–2008191/191TissuemiR-21/miR-155ACT1 = 142; T2 = 49qRT-PCR5 yrs
Wang et al., 2011 [18]China2003–200588/17SerummiR-21SCC: 23.9%, AC: 42%, Others: 34.1%T1, T2 = 47; T3 = 41miRNA array/qRT-PCR52.16 months (1–73)
Gao et al., 2011 [25]ChinaFeb 2004–Jan 200530/30TissuemiR-21SCCT1 = 17; T2 = 12 & T3 = 13miRNA array/qRT-PCR4-5 yrs
Gao et al., 2010 [26]ChinaApr 2008–Sep 200847/47TissuemiR-21/miR-181aSCC: 55.32%; AC: 44.68%T1 = 22; T2 = 12 & T3 = 13miRNA array/qRT-PCRN/A
Voortman et al., 2010 [20]USAN/A697/79TissuemiR-155/miR-21/miR-let-7/miR-29b/miR-34a/b/cNSCLCN/AqRT-PCR8 yrs
Raponi et al., 2009 [28]USAOct 1991–Jul 200261/10TissuemiR-155/mir-146bSCCT1: 33; T2–T4 = 28qRT-PCR3 yrs
Markou et al., 2008 [27]Greece2004–200548/48TissuemiR-21SCC: 47.9%; AC: 52.1%T1 & T2 = 32; T3 & T4 = 16qRT-PCR39 months
Yu et al., 2008 [21]TaiwanSept 2000–Dec 2003112TissuemiR-let-7N/AN/AmiRNA array/qRT-PCRN/A
Yanaihara et al., 2006 [29]USAN/A104/104TissuemiR-let-7/miR-155SCC: 37.5%; AC: 62.5%T1 = 65; T2 = 17; T3 & T4 = 22qRT-PCRN/A
Takamizawa et al., 2004 [32]JapanN/A143TissuemiR-let-7SCC: 17.5%; AC: 73.4%; LCC: 6.3%; ASC: 2.8%T1 = 71; T2 = 19 & T3 = 49qRT-PCRN/A

FF: formalin-fixed; FFPE: formalin-fixed paraffin-embedded; AC: adenocarcinoma; SCC: squamous cell carcinoma; LCC: large-cell carcinoma; ASC: adeno-squamous carcinoma; NSCLC: non-small-cell lung carcinoma; qRT-PCR: quantitative real time PCR; N/A: not available.

All 32 studies reported the prognostic value of 21 different miRNAs explaining OS. The upregulated and downregulated miRNAs reported in all studies are listed in Table 3. Twenty-eight studies reported on tumors at various stages of clinical presentation, whereas this information was absent in seven studies [1315, 20, 21]. In situ hybridization (ISH) was utilized in four studies [15, 22, 23], while miRNA array and quantitative real-time PCR (qRT-PCR) remained the predominant techniques for miRNA detection in the remaining studies.


Consistently reported upregulated and downregulated miRNAs in selected studies
Upregulated miRNAsDownregulated miRNAs
miRNANumber of studies (reference)Number of samplesmiRNANumber of studies (reference)Number of samples

miR-218 [16, 1820, 2427]1871miR-let-75 [18, 20, 21, 29, 32]1445
miR-1556 [1517, 20, 28, 29]2176miR-30a4 [14, 25, 26, 31]380
miR-1825 [14, 18, 21, 28, 31]709miR-1264 [25, 26, 28, 29]433
miR-2104 [14, 28, 29, 31]605miR-181a3 [18, 25, 26]242
miR-314 [14, 25, 26, 31]480miR-1433 [25, 26, 29]362
miR-1913 [17, 28, 29]383miR-486-5p2 [14, 31]226
miR-2053 [18, 27, 29]392miR-3752 [13, 51]313
miR-200a2 [23, 28]339miR-148a2 [22, 33]426
miR-4122 [25, 26]154miR-34b2 [14, 20]845
miR-135b2 [14, 26]300miR-148b2 [34, 35]380
miR-34a2 [20, 25]699miR-29c2 [25, 52]234
miR-1922 [29, 30]342miR-29a2 [25, 26]154

3.2. Study Outcomes

All the included articles reported a close relationship between miRNAs and lung cancer prognosis. Among the 21 reported miRNAs, increased expression of miR-21, miR-155, miR-662, miR-708, miR-31, and miR-146b and decreased expression of miR-148a, miR-29c, miR-200a, miR-148b, miR-383, miR-153, miR-375, miR-155, miR-181a, and miR-let-7 were found associated with poor survival in NSCLC. Five miRNAs (miR-21, miR-155, miR-let-7, miR-148a, and miR-148b) were reported in at least two studies and provided all the key data to perform subgroup meta-analysis. The HRs and 95% CIs extracted from the studies were combined to interrogate the relationship between miRNA expression and lung cancer prognosis. The combined results revealed that both high and low expression levels of the listed miRNAs were associated with a poor prognosis in NSCLC, with a combined HR > 1.5. The combined HR (95% CI) for all 32 studies was calculated as 1.59 (1.39–1.82; ), indicating a high level of heterogeneity (I-squared = 84.97%, ). For all the data showing high heterogeneity, random effects model was applied (Figure 2).

3.3. Subgroup Analysis

Considering the heterogeneity among the studies, the effect of miRNA expression was further evaluated by subgroup analysis. The subgroups were classified according to the repeated miRNAs on the studies, which are the source of those miRNAs, miRNA assay methods, analysis type, and patient origin (Table 4). The association between miRNA expressions and OS outcome was statistically significant in most of the subgroups analysis including miRNA sources, sample origin, miRNA assay by qRT-PCR (HR = 1.05, 95% CI 0.58–1.87, ), and univariate and multivariate analysis (HR = 2.29, 95% CI 1.02–5.12, and HR = 1.54, 95% CI 1.35–1.76, , respectively) except ISH assay method (HR = 1.05, 95% CI 0.58–1.87, ).


SubgroupNumber of patientsNumber of studiesHR (95% CI) valueHeterogeneity
I-square

Overall effect5553321.59 (1.39–1.82)<0.00184.97%<0.001
MicroRNAs
miR-212025101.95 (1.40–2.72)<0.00188.05%<0.001
miR-155204791.33 (0.87–2.04)<0.00173.27%<0.001
miR-let-7123941.94 (0.87–4.32)0.10187.59%<0.001
miR-148a37722.33 (0.80–6.71)0.11757.92%0.123
miR-148b38022.28 (1.64–3.17)<0.0010.000.749
miRNA assay method
ISH75041.05 (0.58–1.87)0.87075.51%0.007
Microarray/qRT-PCR4803281.63 (1.42–1.87)<0.00185.49%<0.001
Analysis type
Multivariate4785281.54 (1.35–1.76)<0.00184.81%<0.001
Univariate76842.29 (1.02–5.12)0.04372.34%0.013
Source of miRNA
Paired Tissue3999201.67 (1.39–1.99)<0.00183.98%<0.001
Blood61141.73 (1.13–2.65)0.01268.02%0.025
Patient origin
Asia3432202.05 (1.66–2.53)<0.00178.85%<0.001
Europe66261.24 (1.05–1.47)0.01161.28%0.006
USA143962.26 (1.81–2.83)<0.0010.000.946

ISH: in situ hybridization; qRT-PCR: quantitative real-time polymerase chain reaction; HR: hazard ratio; CI: confidence intervals.

For all 20 studies using the paired tissue samples as patient’s sample, the random effect model pooled HR for OS was calculated as 1.67 (95% CI: 1.39–1.99, ), suggesting significant heterogeneity among the studies. Moreover, significant publication bias observed (Egger’s test, ) among the included studies. High miRNA expression levels were observed in tumor tissues compared to normal adjacent tissue. The overexpression of miR-21 [16, 19, 20, 2427], miR-155 [15, 16, 20, 28, 29], miR-662 [30], miR-708 [14], miR-31 [31], and miR-146b [28] predicted poor OS despite the cancer site. As eight studies did not specify if the patient’s samples were taken as paired tissue sample or just single cancer tissue samples, these were excluded from paired tissue sample subgroup. Four studies targeted serum or plasma miRNAs, where both lower and higher expression levels of miRNAs were found associated with poor survival as well, with the combined HR 1.73 (95% CI: 1.13–2.65, ). No apparent bias was observed (Egger’s test, ) among the studies.

Another subgroup analysis was performed for the location of sample collection to explore the cause of the heterogeneity between studies. The Asian and European subgroups exhibited greater heterogeneity (I-squared, values approximately 78.85%, <0.001 and 61.28%, 0.006, respectively) compared to the American subgroup (I-squared: 0.00% and value: 0.946). However, no significant publication bias was observed in the Asian and European studies (Egger’s test, and , respectively) compared to the American studies (Egger’s test, ). Overall, higher expression levels of miRNAs (miR-21, miR-155, miR-662, and miR-31) and lower expression levels of miRNAs (miR-148a, miR-29c, miR-200a, miR-148b, miR-181a, miR-153, miR-383, miR-375, and miR-let-7) reflected poorer prognosis. Particularly, the high expression level of miR-21, miR-155, miR-708, and miR-146b were correlated with poor overall survival in American studies.

Five miRNAs (miR-21, miR-155, miR-let-7, miR-148a, and miR-148b) were reported in at least two studies and were specifically analysed under subgroup analysis to evaluate the association between miRNA expression and overall survival in NSCLC.

3.3.1. miR-21 Expression in NSCLC Prognosis

Eight articles (n = 2025) reported the effect of miRNA-21 on the prognosis of NSCLC patients (Figure 2(g)). Of these studies, seven provided overall survival data and one provided relapse-free survival data [16]. Evident heterogeneity was detected among all the studies (I-square = 88.05%, ), suggesting the presence of other contributing factors. Overall, the random-effects model revealed that miRNA-21 expression was inversely associated with OS (HR: 1.95; 95% CI: 1.40–2.72; ) in NSCLC patients. However, the asymmetry test (OS, Egger test, ) indicated the existence of symmetry in the funnel plot which indicated no apparent bias in the studies included in the meta-analysis.

3.3.2. miR-155 Expression in NSCLC Prognosis

Figure 2(h) displays the forest plot representation for the analysis of miRNA-155 and OS. Six articles () with nine individual cohort studies were subjected to the analysis. The random effect model was used to calculate the pooled effect size due to the presence of prominent heterogeneity among studies (I-square = 73.27%, ). Elevated miRNA-155 expression was identified as a moderate predictor of poor OS regardless of the source of miRNAs. The pooled HR for OS was calculated as 1.33 (95% CI: 0.87–2.04, ), suggesting no statistical significance. Even though significant interstudy heterogeneity was observed, the Egger test result indicated the presence of no significant publication bias () among the studies.

3.3.3. miR-let-7 Expression and NSCLC Prognosis

Four studies () evaluated the association between miR-let-7 expression in the tumor tissue samples and the prognosis of NSCLC patients, with two reporting OS [20, 21] and the other two with postoperative survivals [29, 32]. The adjusted HR was calculated as 1.94 (95% CI: 0.87–4.32) using random-effect model, suggesting prominent heterogeneity (I-square = 87.59%, ). Moreover, significant publication bias observed among these selected studies (Egger’s test, ). The calculated high HR value concluded that downregulation of miR-let-7 in tumor tissue was associated with poor overall survival of the NSCLC patients among those studies.

3.3.4. miRNA-148a and NSCLC Prognosis

Two studies () suggested that low miRNA-148a expression levels were associated with poor survival in the patients with NSCLC [22, 33]. Evident interstudy heterogeneity was observed across these studies (I-square = 57.92%, ). The pooled HR for OS was calculated as 2.33 (95% CI: 0.80–6.71, ), suggesting a significant impact of miR-148a downregulation on the OS in NSCLC patients.

3.3.5. miRNA-148b and NSCLC Prognosis

Two studies () reported lower miR-148b expression as a predictor for poor OS in NSCLC patients using multivariate analysis [34, 35]. No significant heterogeneity was observed across these studies (OS, I-square = 0.00%, ). Our analysis also revealed that the low miR-148b expression is associated with a significant poor prognosis. The pooled HR for OS was calculated as 2.28 (95% CI: 1.64–3.17, ).

3.4. Publication Bias

Finally, publication bias of the included studies was assessed by a Begg’s funnel plot and Egger’s test (Figure 3). The result of both Begg’s test () and Egger’s test () provided the statistical evidence of funnel plot asymmetry concluding apparent bias in the studies included in the meta-analysis.

3.5. Sensitivity Analysis

Sensitivity analysis was performed to evaluate whether the differences between studies induced instability in the meta-analysis or not. It was performed by sequential omission of individual studies using the fixed-effects model. No particular study was identified that influenced the overall results.

4. Discussion

We conducted a comprehensive systematic literature review to explore the utility of miRNA biomarkers that can be robustly evaluated in predicting prognosis in NSCLC patients. To our knowledge, this is the first extensive meta-analysis undertaken including the wider time frame (January 2004 to March 2017) and a wide range of miRNAs from both paired and liquid biopsy samples, and their subsequent ability to determine NSCLC prognosis. This meta-analysis pooled high-quality global studies concerning various miRNA expressions and cancer prognosis regarding OS.

Although miRNAs studied in the previous studies were found to be positively or negatively associated with prognosis in NSCLC, most of them were presented in separate studies. In our combined analysis, five different miRNAs (miR-21, miR-155, miR-let-7, miR-148a, and miR-148b) were evaluated in at least two selected studies using key statistics and OS data. We performed a subgroup meta-analysis of the effect of these five miRNAs on the survival of NSCLC patients as well. The meta-analysis results suggested that an elevated expression of miR-21 () and miR-155 () in cancerous tissue and liquid biopsy samples were associated with poor survival, whereas lower expression of miR-let-7 () and miR-148a/b ( and ) also predicted shorter postoperative and overall survival among the NSCLC studies [1522, 2429, 3235].

The studies that used OS as a primary endpoint had high heterogeneity. This issue of heterogeneity was addressed in this study by performing a subgroup analysis. The OS, consolidated HR, and 95% CI were statistically significant in most of the studies, indicating that overexpression or underexpression of any of these miRNAs may result in a poor prognosis for NSCLC patients. Subgroup analysis based on geography revealed that the studies from America (USA) produced statistically not significant results compared to equivalent studies from Europe and Asia. These findings can conclude that miRNA expression is associated with a poorer prognosis in Asian and European NSCLC population.

Since the initial association of miR-21 with cancer in 2005, it is now considered one of the most extensively explored cancer-related miRNAs [36, 37] and may serve as a key regulator in oncogenic processes including tumor growth, migration, and invasion [38]. A growing body of evidence further supports miR-21 as a potential diagnostic and prognostic biomarker in various carcinomas [7]. Moreover, elevated miR-21 expression levels have been found associated with disease-free survival outcomes in cancer patients [8]. However, a meta-analysis by Ma et al., [9] including eight articles found no prognostic significance of miRNA-21 expression in NSCLC. Moreover, a cohort study by Voortman [20] using a large number of participants found neither predictive nor prognostic significance with miR-21 expression patterns, however, significantly associated with the age and tumor stage of the NSCLC patient’s in OS. In addition, a study by Olivieri et al. [10] suggested that miRNA-21 and miRNA-155 are also upregulated in a normal person without cancer and can be associated with inflammation and senescence. Hence, there are conflicting reports as to the benefit of miR-21 as a prognostic biomarker in cancer. However, a series of recent quantitative analysis based on published studies did, in fact, suggest a significant association between high miR-21 expression levels and poor survival in NSCLC patients [8, 16, 19, 2427, 3941]. This meta-analysis study also supported those previous results, with the pooled effect size calculated by random effect model suggesting high expression levels of miR-21 as a moderate predictor of poor OS (HR: 1.95 and with 95% CI: 1.40–2.72) in NSCLC patients.

Evidences show that miR-155 is overexpressed in various solid tumors, including breast, lung, colon, pancreatic, and thyroid [7, 11, 42], and also plays a positive role in the development of a tumor [43]. Several studies suggest promising associations between elevated miR-155 levels and prognosis in NSCLC patients [11, 41, 43, 44]. Our meta-analysis comprised nine independent studies [1719, 31, 34] that described the significant prognostic effect of miR-155 expression on OS among NSCLC patients, except Voortman [20], who suggested no significant association. Our combined result also supported the evidence from most of the previous studies suggesting that the high miR-155 expression is likely to result in unfavourable outcomes in NSCLC patients.

MiR-let-7 is considered as a protective miRNA that is downregulated in various cancers including lung cancer [29, 45, 46]. Previous studies have described that low expression of miR-let-7 is significantly associated with a poor prognosis in NSCLC [21, 28, 29, 32, 46, 47]. Similarly, our study also found an association between low miR-let-7 expression levels and a poor prognosis in NSCLC studies.

Additionally, another two downregulated miRNAs (miR-148a and miR-148b) were meta-analysed separately for the first time for NSCLC prognosis. Various studies have described the significant association of miR-148a/b overexpression level to the enhanced OS outcome among NSCLC patients [22, 3335, 48, 49]. Less heterogeneity was observed with either of these two miRNAs in our study. The fixed effect model pooled significant HR values for the downregulation of both miRNAs that further suggested a significant prognostic role in NSCLC.

Some limitations must be considered when interpreting the results of this current study. First, the number of studies available was limited. More studies based on the prognostic role are needed to further strengthen these associations. Secondly, significant heterogeneity was observed in some of the studies, likely due to the differences in patient’s clinicopathological characteristics (ethnicity, nationality, gender, age, tumor stage, and tumor grade) and different assay methods, cut-off values for the miRNA expression levels, sample preparation methods (i.e., paraffin-fixed, formalin-fixed, freshly frozen tumors, or liquid biopsy samples), follow-up durations, and key statistic parameters available. Thirdly, circulating biomarkers are more valuable and reliable than tissue biomarkers as they can be assayed before surgery and monitored throughout the tumor progression. Hence, more liquid biopsy sample-based studies need to be included. Lastly, a significant publication bias among the studies may have influenced the overall outcome. Some miRNAs that were chosen empirically or without clear justification in studies could have led to imprecise outcomes. The number of statistically insignificant studies [16, 20, 23, 24] was 15.6% (5 out of 32) and may have limited the statistical power. Patient age could be another variable that might have contributed towards heterogeneity, as four out of the 32 studies [16, 22, 50, 51] showed significant association of age with OS in NSCLC patients. Therefore, the selection of standardized protocol-based studies may likely improve the quality of such analysis. Even though there were heterogeneity, biases, and other limitations, there is growing evidence for the remarkable potential of miRNAs as prognostic biomarkers in NSCLC. More studies should be undertaken in the future to evaluate the prognostic value of specific miRNAs in serum. Large-scale and standard investigations may provide a better understanding of the mode of action and the miRNA targets, to give further insight into the use of miRNAs in lung cancer prognosis, ultimately leading to greater clinical application outcomes.

5. Conclusions

Several miRNAs are established to play critical roles in the initiation and development of NSCLC by functioning either as oncogenes or as tumor suppressor genes. Global miRNA expressions analysed from tumor specimens and liquid biopsy samples from patients may have a clinical relevance to serve for diagnosis, prognosis, and therapeutic outcomes in NSCLC. Our meta-analysis, representing a quantified synthesis of all published studies suggests that specific miRNA signatures which are up- or downregulated in NSCLC are associated with the poor OS and have potential prognostic and predictive value. However, large-scale standardized protocol-based studies are required to improve the accuracy and reduce the bias.

Conflicts of Interest

The authors declare that they have no conflict of interests.

Authors’ Contributions

SRL contributed to the publication search, data extraction, draft writing, and conception and design. TT, PDI, HG, and NM contributed to the quality assessment, conception and design, and editing. SM contributed to the statistical analysis.

Supplementary Materials

The scientific literature published from January 2004 to March 2017 was interrogated using 5 different search engines: Scopus, PubMed, Science Direct, Web of Science, and Medline using key search words, including “microRNA expression or miRNA expression,” “lung cancer or NSCLC,” “prognosis,” “radiotherapy,” “radioresistance,” “radiosensitivity,” and “Human”. Literature search results are noted in Supplementary Table 1. (Supplementary Materials)

References

  1. L. A. Torre, R. L. Siegel, and A. Jemal, “Lung cancer statistics,” in Lung cancer and personalized medicine, pp. 1–19, Springer, Cham, 2016. View at: Publisher Site | Google Scholar
  2. American Cancer Society, “Non-Small Cell Lung cancer,” May 2018, https://www.cancer.org/cancer/non-small-cell-lung-cancer.html. View at: Google Scholar
  3. K. Inamura and Y. Ishikawa, “MicroRNA in lung cancer: novel biomarkers and potential tools for treatment,” Journal of Clinical Medicine, vol. 5, no. 3, p. 36, 2016. View at: Publisher Site | Google Scholar
  4. P. Guan, Z. Yin, X. Li, W. Wu, and B. Zhou, “Meta-analysis of human lung cancer microRNA expression profiling studies comparing cancer tissues with normal tissues,” Journal of Experimental & Clinical Cancer Research, vol. 31, no. 1, p. 54, 2012. View at: Publisher Site | Google Scholar
  5. K. Inamura, “Diagnostic and therapeutic potential of microRNAs in lung cancer,” Cancers, vol. 9, no. 12, p. 49, 2017. View at: Publisher Site | Google Scholar
  6. B. Zhang, X. Pan, G. P. Cobb, and T. A. Anderson, “microRNAs as oncogenes and tumor suppressors,” Developmental Biology, vol. 302, no. 1, pp. 1-2, 2007. View at: Publisher Site | Google Scholar
  7. A. Izzotti, S. Carozzo, A. Pulliero, D. Zhabayeva, J. L. Ravetti, and R. Bersimbaev, “Extracellular MicroRNA in liquid biopsy: applicability in cancer diagnosis and prevention,” American Journal of Cancer Research, vol. 6, no. 7, pp. 1461–1493, 2016. View at: Google Scholar
  8. Y. Wang, X. Gao, F. Wei et al., “Diagnostic and prognostic value of circulating miR-21 for cancer: a systematic review and meta-analysis,” Gene, vol. 533, no. 1, pp. 389–397, 2014. View at: Publisher Site | Google Scholar
  9. X. L. Ma, L. Liu, X. X. Liu et al., “Prognostic role of microRNA-21 in non-small cell lung cancer: a meta-analysis,” Asian Pacific Journal of Cancer Prevention, vol. 13, no. 5, pp. 2329–2334, 2012. View at: Publisher Site | Google Scholar
  10. F. Olivieri, M. C. Albertini, M. Orciani et al., “DNA damage response (DDR) and senescence: shuttled inflamma-miRNAs on the stage of inflamm-aging,” Oncotarget, vol. 6, no. 34, pp. 35509–35521, 2015. View at: Publisher Site | Google Scholar
  11. S. Jiang, H. W. Zhang, M. H. Lu et al., “MicroRNA-155 functions as an OncomiR in breast cancer by targeting the suppressor of cytokine signaling 1 gene,” Cancer Research, vol. 70, no. 8, pp. 3119–3127, 2010. View at: Publisher Site | Google Scholar
  12. A. Liberati, D. G. Altman, J. Tetzlaff et al., “The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration,” PLoS Medicine, vol. 6, no. 7, article e1000100, 2009. View at: Publisher Site | Google Scholar
  13. H. Yu, L. Jiang, C. Sun et al., “Decreased circulating miR-375: a potential biomarker for patients with non-small-cell lung cancer,” Gene, vol. 534, no. 1, pp. 60–65, 2014. View at: Publisher Site | Google Scholar
  14. J. S. Jang, H. S. Jeon, Z. Sun et al., “Increased miR-708 expression in NSCLC and its association with poor survival in lung adenocarcinoma from never smokers,” Clinical Cancer Research, vol. 18, no. 13, pp. 3658–3667, 2012. View at: Publisher Site | Google Scholar
  15. T. Donnem, K. Eklo, T. Berg et al., “Prognostic impact of MiR-155 in non-small cell lung cancer evaluated by in situ hybridization,” Journal of Translational Medicine, vol. 9, no. 1, p. 6, 2011. View at: Publisher Site | Google Scholar
  16. M. Saito, A. J. Schetter, S. Mollerup et al., “The association of microRNA expression with prognosis and progression in early-stage, non–small cell lung adenocarcinoma: a retrospective analysis of three cohorts,” Clinical Cancer Research, vol. 17, no. 7, pp. 1875–1882, 2011. View at: Publisher Site | Google Scholar
  17. C. Sanfiorenzo, M. I. Ilie, A. Belaid et al., “Two panels of plasma microRNAs as non-invasive biomarkers for prediction of recurrence in resectable NSCLC,” PLoS One, vol. 8, no. 1, article e54596, 2013. View at: Publisher Site | Google Scholar
  18. X.-C. Wang, L. Q. Du, L. L. Tian et al., “Expression and function of miRNA in postoperative radiotherapy sensitive and resistant patients of non-small cell lung cancer,” Lung Cancer, vol. 72, no. 1, pp. 92–99, 2011. View at: Publisher Site | Google Scholar
  19. W. Xiao-chun, W. Wei, Z. Zhu-Bo, Z. Jing, T. Xiao-Gang, and L. Jian-Chao, “Overexpression of miRNA-21 promotes radiation-resistance of non-small cell lung cancer,” Radiation Oncology, vol. 8, no. 1, p. 146, 2013. View at: Publisher Site | Google Scholar
  20. J. Voortman, A. Goto, J. Mendiboure et al., “MicroRNA expression and clinical outcomes in patients treated with adjuvant chemotherapy after complete resection of non–small cell lung carcinoma,” Cancer Research, vol. 70, no. 21, pp. 8288–8298, 2010. View at: Publisher Site | Google Scholar
  21. S.-L. Yu, H. Y. Chen, G. C. Chang et al., “MicroRNA signature predicts survival and relapse in lung cancer,” Cancer Cell, vol. 13, no. 1, pp. 48–57, 2008. View at: Publisher Site | Google Scholar
  22. Y. Chen, L. Min, C. Ren et al., “miRNA-148a serves as a prognostic factor and suppresses migration and invasion through Wnt 1 in non-small cell lung cancer,” PLoS One, vol. 12, no. 2, article e0171751, 2017. View at: Publisher Site | Google Scholar
  23. Y. Chen, M. Du, J. Wang et al., “MiRNA-200a expression is inverse correlation with hepatocyte growth factor expression in stromal fibroblasts and its high expression predicts a good prognosis in patients with non-small cell lung cancer,” Oncotarget, vol. 7, no. 30, pp. 48432–48442, 2016. View at: Publisher Site | Google Scholar
  24. X. G. Liu, W. Y. Zhu, Y. Y. Huang et al., “High expression of serum miR-21 and tumor miR-200c associated with poor prognosis in patients with lung cancer,” Medical Oncology, vol. 29, no. 2, pp. 618–626, 2012. View at: Publisher Site | Google Scholar
  25. W. Gao, H. Shen, L. Liu, J. Xu, J. Xu, and Y. Shu, “MiR-21 overexpression in human primary squamous cell lung carcinoma is associated with poor patient prognosis,” Journal of Cancer Research and Clinical Oncology, vol. 137, no. 4, pp. 557–566, 2011. View at: Publisher Site | Google Scholar
  26. W. Gao, Y. Yu, H. Cao et al., “Deregulated expression of miR-21, miR-143 and miR-181a in non small cell lung cancer is related to clinicopathologic characteristics or patient prognosis,” Biomedicine & Pharmacotherapy, vol. 64, no. 6, pp. 399–408, 2010. View at: Publisher Site | Google Scholar
  27. A. Markou, E. G. Tsaroucha, L. Kaklamanis, M. Fotinou, V. Georgoulias, and E. S. Lianidou, “Prognostic value of mature microRNA-21 and microRNA-205 overexpression in non–small cell lung cancer by quantitative real-time RT-PCR,” Clinical Chemistry, vol. 54, no. 10, pp. 1696–1704, 2008. View at: Publisher Site | Google Scholar
  28. M. Raponi, L. Dossey, T. Jatkoe et al., “MicroRNA classifiers for predicting prognosis of squamous cell lung cancer,” Cancer Research, vol. 69, no. 14, pp. 5776–5783, 2009. View at: Publisher Site | Google Scholar
  29. N. Yanaihara, N. Caplen, E. Bowman et al., “Unique microRNA molecular profiles in lung cancer diagnosis and prognosis,” Cancer Cell, vol. 9, no. 3, pp. 189–198, 2006. View at: Publisher Site | Google Scholar
  30. M. Skrzypski, P. Czapiewski, K. Goryca et al., “Prognostic value of microRNA expression in operable non-small cell lung cancer patients,” British Journal of Cancer, vol. 110, no. 4, pp. 991–1000, 2014. View at: Publisher Site | Google Scholar
  31. X. Tan, W. Qin, L. Zhang et al., “A 5-microRNA signature for lung squamous cell carcinoma diagnosis and hsa-miR-31 for prognosis,” Clinical Cancer Research, vol. 17, no. 21, pp. 6802–6811, 2011. View at: Publisher Site | Google Scholar
  32. J. Takamizawa, H. Konishi, K. Yanagisawa et al., “Reduced expression of the let-7 microRNAs in human lung cancers in association with shortened postoperative survival,” Cancer Research, vol. 64, no. 11, pp. 3753–3756, 2004. View at: Publisher Site | Google Scholar
  33. Y. Chen, L. Min, X. Zhang et al., “Decreased miRNA-148a is associated with lymph node metastasis and poor clinical outcomes and functions as a suppressor of tumor metastasis in non-small cell lung cancer,” Oncology Reports, vol. 30, no. 4, pp. 1832–1840, 2013. View at: Publisher Site | Google Scholar
  34. R. Wang, F. Ye, Q. Zhen et al., “MicroRNA-148b is a potential prognostic biomarker and predictor of response to radiotherapy in non-small-cell lung cancer,” Journal of Physiology and Biochemistry, vol. 72, no. 2, pp. 337–343, 2016. View at: Publisher Site | Google Scholar
  35. H. Ge, B. Li, W. X. Hu et al., “MicroRNA-148b is down-regulated in non-small cell lung cancer and associated with poor survival,” International Journal of Clinical and Experimental Pathology, vol. 8, no. 1, pp. 800–805, 2015. View at: Google Scholar
  36. J. A. Chan, A. M. Krichevsky, and K. S. Kosik, “MicroRNA-21 is an antiapoptotic factor in human glioblastoma cells,” Cancer Research, vol. 65, no. 14, pp. 6029–6033, 2005. View at: Publisher Site | Google Scholar
  37. W. Zhu and B. Xu, “MicroRNA-21 identified as predictor of cancer outcome: a meta-analysis,” PLoS One, vol. 9, no. 8, article e103373, 2014. View at: Publisher Site | Google Scholar
  38. S. D. Selcuklu, M. T. A. Donoghue, and C. Spillane, “miR-21 as a key regulator of oncogenic processes,” Biochemical Society Transactions, vol. 37, no. 4, pp. 918–925, 2009. View at: Publisher Site | Google Scholar
  39. Y. Wang, J. Li, L. Tong et al., “The prognostic value of miR-21 and miR-155 in non-small-cell lung cancer: a meta-analysis,” Japanese Journal of Clinical Oncology, vol. 43, no. 8, pp. 813–820, 2013. View at: Publisher Site | Google Scholar
  40. Y. Yuan, X. Y. Xu, H. G. Zheng, and B. J. Hua, “Elevated miR-21 is associated with poor prognosis in non-small cell lung cancer: a systematic review and meta-analysis,” European review for medical and pharmacological sciences, vol. 22, no. 13, pp. 4166–4180, 2018. View at: Publisher Site | Google Scholar
  41. M. Yang, H. Shen, C. Qiu et al., “High expression of miR-21 and miR-155 predicts recurrence and unfavourable survival in non-small cell lung cancer,” European Journal of Cancer, vol. 49, no. 3, pp. 604–615, 2013. View at: Publisher Site | Google Scholar
  42. S. Volinia, G. A. Calin, C. G. Liu et al., “A microRNA expression signature of human solid tumors defines cancer gene targets,” Proceedings of the National Academy of Sciences, vol. 103, no. 7, pp. 2257–2261, 2006. View at: Publisher Site | Google Scholar
  43. F. Wang, J. Zhou, Y. Zhang et al., “The value of microRNA-155 as a prognostic factor for survival in non-small cell lung cancer: a meta-analysis,” PLoS One, vol. 10, no. 8, article e0136889, 2015. View at: Publisher Site | Google Scholar
  44. T. P. Xu, C. H. Zhu, J. Zhang et al., “MicroRNA-155 expression has prognostic value in patients with non-small cell lung cancer and digestive system carcinomas,” Asian Pacific Journal of Cancer Prevention, vol. 14, no. 12, pp. 7085–7090, 2013. View at: Publisher Site | Google Scholar
  45. Y. Dai, D. Wang, X. Tian et al., “Insights into the application of let-7 family as promising biomarker in cancer screening,” Tumor Biology, vol. 36, no. 7, pp. 5233–5239, 2015. View at: Publisher Site | Google Scholar
  46. C. L. Zhang, Z. Li, Y. P. Liu, Y. Wu, and X. J. Qu, “Prognostic role of the let-7 family in various carcinomas: a meta-analysis update,” Journal of BUON, vol. 20, no. 2, pp. 631–644, 2015. View at: Google Scholar
  47. Y. Xia, Y. Zhu, X. Zhou, and Y. Chen, “Low expression of let-7 predicts poor prognosis in patients with multiple cancers: a meta-analysis,” Tumor Biology, vol. 35, no. 6, pp. 5143–5148, 2014. View at: Publisher Site | Google Scholar
  48. J. S. Yang, B. J. Li, H. W. Lu et al., “Serum miR-152, miR-148a, miR-148b, and miR-21 as novel biomarkers in non-small cell lung cancer screening,” Tumor Biology, vol. 36, no. 4, pp. 3035–3042, 2015. View at: Publisher Site | Google Scholar
  49. C. Miao, J. Zhang, K. Zhao et al., “The significance of microRNA-148/152 family as a prognostic factor in multiple human malignancies: a meta-analysis,” Oncotarget, vol. 8, no. 26, pp. 43344–43355, 2017. View at: Publisher Site | Google Scholar
  50. W. J. Chen, E. N. Zhang, Z. K. Zhong et al., “MicroRNA-153 expression and prognosis in non-small cell lung cancer,” International Journal of Clinical and Experimental Pathology, vol. 8, no. 7, pp. 8671–8675, 2015. View at: Google Scholar
  51. Y. Li, Q. Jiang, N. Xia, H. Yang, and C. Hu, “Decreased expression of microRNA-375 in nonsmall cell lung cancer and its clinical significance,” Journal of International Medical Research, vol. 40, no. 5, pp. 1662–1669, 2012. View at: Publisher Site | Google Scholar
  52. L. Liu, N. Bi, L. Wu et al., “MicroRNA-29c functions as a tumor suppressor by targeting VEGFA in lung adenocarcinoma,” Molecular Cancer, vol. 16, no. 1, p. 50, 2017. View at: Publisher Site | Google Scholar
  53. Y. Shang, A. Zang, J. Li et al., “MicroRNA-383 is a tumor suppressor and potential prognostic biomarker in human non-small cell lung cancer,” Biomedicine & Pharmacotherapy, vol. 83, pp. 1175–1181, 2016. View at: Publisher Site | Google Scholar

Copyright © 2018 Shree Ram Lamichhane et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


More related articles

 PDF Download Citation Citation
 Download other formatsMore
 Order printed copiesOrder
Views2332
Downloads463
Citations

Related articles

We are committed to sharing findings related to COVID-19 as quickly as possible. We will be providing unlimited waivers of publication charges for accepted research articles as well as case reports and case series related to COVID-19. Review articles are excluded from this waiver policy. Sign up here as a reviewer to help fast-track new submissions.