A Novel RNA-Seq-Based Model for Preoperative Prediction of Lymph Node Metastasis in Oral Squamous Cell Carcinoma

Qiao, Bo; Zhao, Min; Wu, Jing; Wu, Huan; Zhao, Yiming; Meng, Fanhao; Tian, Yu; Wang, Situo; Shi, Jinlong; Zhang, Haizhong

doi:https://doi.org/10.1155/2020/4252580

BioMed Research International

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusion Abbreviations Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments Supplementary Materials References Copyright Related Articles

Special Issue

Applications of Bioinformatics and Systems Biology in Precision Medicine and Immuno-Oncology 2020

View this Special Issue

Research Article | Open Access

Volume 2020 | Article ID 4252580 | https://doi.org/10.1155/2020/4252580

A Novel RNA-Seq-Based Model for Preoperative Prediction of Lymph Node Metastasis in Oral Squamous Cell Carcinoma

Bo Qiao,^1,2Min Zhao,³Jing Wu,³Huan Wu,³Yiming Zhao,⁴Fanhao Meng,²Yu Tian,²Situo Wang,²Jinlong Shi,³and Haizhong Zhang²

Guest Editor: Tao Huang

Received03 Jul 2020

Revised03 Aug 2020

Accepted05 Aug 2020

Published31 Aug 2020

Abstract

Objective. To develop and validate a novel RNA-seq-based nomogram for preoperative prediction of lymph node metastasis (LNM) for patients with oral squamous cell carcinoma (OSCC). Methods. RNA-seq data for 276 OSCC patients (including 157 samples with LNM and 119 without LNM) were downloaded from TCGA database. Differential expression analysis was performed between LNM and non-LNM of OSCC. These samples were divided into a training set and a test set by a ratio of 9 : 1 while the relative proportion of the non-LNM and LNM groups was kept balanced within each dataset. Based on clinical features and seven candidate RNAs, we established a prediction model of LNM for OSCC using logistic regression analysis. Tenfold crossvalidation was utilized to examine the accuracy of the nomogram. Decision curve analysis was performed to evaluate the clinical utility of the nomogram. Results. A total of 139 differentially expressed RNAs were identified between LNM and non-LNM of OSCC. Seven candidate RNAs were screened based on FPKM values, including NEURL1, AL162581.1 (miscRNA), AP002336.2 (lncRNA), CCBE1, CORO6, RDH12, and AC129492.6 (pseudogene). Logistic regression analysis revealed that the clinical N stage () was an important factor to predict LNM. Moreover, three RNAs including RDH12 ( value < 0.05), CCBE1 ( value < 0.01), and AL162581.1 ( value < 0.05) could be predictive biomarkers for LNM in OSCC patients. The average accuracy rate of the model was 0.7661, indicating a good performance of the model. Conclusion. Our findings constructed an RNA-seq-based nomogram combined with clinicopathology, which could potentially provide clinicians with a useful tool for preoperative prediction of LNM and be tailored for individualized therapy in patients with OSCC.

1. Introduction

Oral squamous cell carcinoma (OSCC) accounts for 95% of all oral malignancies, and its five-year survival rate is up to 50%-60% [1]. Lymph node metastasis (LNM) is considered to be an independent prognostic factor of OSCC, which is associated with tumor recurrence and prognosis [2–4]. Only 25-40% of OSCC patients with LNM at diagnosis will survive 5 years, compared to approximately 90% of those without LNM (non-LNM) [5]. Therefore, accurate assessment of the nodal status and decision about concurrent cervical lymph node dissection is of utmost importance for prognosis and therapy of OSCC.

Unfortunately, there is still no widely accepted method for noninvasive detection for preoperative prediction of LNM in OSCC currently. For OSCC patients with clinically negative neck (cN0), whether to perform cervical lymph node dissection remains a hot topic. Using current methods to predict LNM, approximately 70% of patients with cN0 OSCC who undergo elective neck dissection (END) are found to be pathologically node negative [6]. It is imminent to best select patients with LNM who will benefit from END and to decrease the cost and morbidity of neck dissection in those without LNM [7].

Emerging sequencing technologies in genomics and transcriptomics have characterized many types of human cancers in specific molecules, which provide a critical relationship between cell phenotypes and their molecular characteristics, and new biomarkers or therapeutic strategies for patients [8, 9]. To our knowledge, no nomograms based on RNA-seq have been used to predict LNM in OSCC. We hypothesized that RNA-seq-based nomograms could improve the prediction of LNM in OSCC, so that patients who will benefit from END can be more accurately identified, while retaining END is unlikely to be beneficial. In this study, logistic regression analysis was used to screen for high risk factors for OSCC patients with LNM. We aimed to establish and verify a novel RNA-seq-based nomogram combined with clinicopathological factors to predict LNM in OSCC patients, which may provide an auxiliary tool for personalized precise treatment and assist the clinical therapy decision for OSCC patients.

2. Materials and Methods

2.1. Data Acquirement

OSCC RNA-seq were obtained from The Cancer Genome Atlas database (TCGA) (https://portal.gdc.cancer.gov/). Screening conditions were as follows: (a) primary sites: hard palate, lip, oral cavity, or oral tongue; (b) disease type: squamous cell neoplasms; (c) experimental strategy: RNA-seq; (d) sample type: primary tumor; and (e) clinical information was composed of AJCC pathological N status. Finally, a total of 276 OSCC samples with gene expression data and corresponding clinical information were utilized for this study, including 157 samples with lymph node metastasis (LNM) and 119 samples without LNM (non-LNM).

The GSE9844 microarray dataset was downloaded from the Gene Expression Omnibus (GEO) database (https://www.ncbi.nlm.nih.gov/gds), including 26 oral tongue squamous cell carcinoma (OTSCC) samples [10]. Among them, 11 samples had lymph node metastasis.

2.2. Differential Expression Analyses

Differential expression analyses were performed between LNM and non-LNM OSCC samples using the DESeq2 package in R (version 1.18.1) [11]. Differentially expressed RNAs (DERNAs) were identified in line with adjusted value < 0.05 and . The overall distribution of DERNAs was visualized into the volcano plot. A functionally grouped network of pathways was constructed using the ClueGO (version 2.5.1) [12, 13] of Cytoscape (version 3.6.1) [14]. The “load marker list” was set to differential gene sets for enrichment analysis, the “show only pathways with value” was set to 0.05, and other settings were set to default.

2.3. Variable Selection Method

The chi-square (χ²) test was used to analyze the difference of patient demography, risk exposure, clinical characteristics, and histopathological features between LNM and non-LNM OSCC samples by SPSS software (version 24.0). was considered statistically significant. Characteristic genes related to LNM were screened utilizing the Boruta package in R [15] (version 6.0.0) based on FPKM values from the expression profile of the GSE9844 dataset, which were plotted into a box plot by the ggplot2 package (version 3.2.1).

2.4. Classification Model Fitting and Validation

After removing the samples with incomplete clinical N stage (cN) information, a total of 265 samples were retained and randomly divided into the training set and the test set by a ratio of 9 : 1 while the relative proportion of non-LNM and LNM groups was kept balanced within each dataset. A classification model of the 10-fold crossvalidation was constructed utilizing the R language (version 3.4.4). In a training set, a RF model was built using the “random forest” package in R (version 4.6-14) [16], followed by support vector machine (SVM) model by the “e1071” package in R (version 1.7-2) [17]. Basic function “glm” in R (version 3.4.4) was used to fit the generalized logistic regression model, and the “XGBoost” package in R (version 0.90.0.2) [18] was utilized to implement the XGBoost model. The accuracy, sensitivity, and specificity of the four models were evaluated on the test set according to the calibration curve and ROC curve by the “rms” package (version 5.1-3.1) [19] and “pROC” package (version 1.15.3) in R. Area under the curve (AUC) was used to compare the diagnostic performance of the models. Furthermore, the nomogram of the logistic regression model was performed by the “regplot” package in R (version 0.2) [20]. Then, decision curve analysis (DCA) was conducted to estimate the clinical value of our nomogram between two groups using the “rmda” package (version 1.6) [21], which could analyze the net benefit of the cN and RNA scores for prediction of LNM for OSCC patients.

3. Results

3.1. Clinical Characteristics

Our study developed a model for the preoperative prediction of LNM. Figure 1 illustrates the work flowchart of the study. A total of 276 patients with OSCC were included in our study. Table 1 shows the demographic data and pathological characteristics of these patients. Among them, 157 (56.88%) patients had LNM. 265 patients possessed complete clinical N status; among them, 44 had no lymph node metastasis in clinical examination (cN-) but metastasis occurred in the pathological diagnosis (pN+). 22 patients’ clinical examination indicated lymph node metastasis (cN+), but pathological examination results showed no lymph node metastasis (pN-). Furthermore, our data showed that clinical N was significantly different between the two cohorts (). However, there were no significant differences between the two groups in terms of neoplasm histologic grade, tobacco smoking history, and anatomic neoplasm subdivision.

3.2. Identification of Differentially Expressed RNAs between Non-LNM and LNM of OSCC

Volcano plots visualized that there were 139 DERNAs between non-LNM and LNM OSCC (Figure 2), including 104 upregulated and 35 downregulated genes. The specific DERNAs are listed in Supplementary Table 1. To analyze the underlying biological function of DERNAs, functional enrichment analysis was carried out by ClueGO and the database called by the GO biological process in ClueGO. Significant biological processes enriched by DERNAs are shown in Figure 3. These DEmRNAs were mainly involved in “regulation of striated muscle contraction,” “regulation of muscle system process,” and “muscle filament sliding.” These results indicated that a variety of biological processes of muscle could be involved in lymph node metastasis of OSCC.

3.3. Selection of Candidate DERNAs to Predict LNM of OSCC

The Boruta algorithm was used to screen out the signature genes to distinguish non-LNM and LNM of OSCC. Figure 4 shows the change in -score of 139 DERNAs during Boruta’s operation. The blue boxplots indicated the minimum, average, and maximum -scores of the shadow gene. The red and green boxplots indicated the -score of the rejection attribute and confirmation genes, and yellow colors represented suggestive genes. These findings showed that the most important shadow attribute -score clearly separated important and nonimportant genes. Finally, a total of seven candidate DERNAs were identified for distinguishing non-LNM and LNM of OSCC, including NEURL1, AL162581.1 (miscRNA), AP002336.2 (lncRNA), CCBE1, CORO6, RDH12, and AC129492.6 (pseudogene). Among them, expression profiles of four DERNAs were obtained from the expression profile of the GSE9844 dataset. In Figure 5, we found that the expression levels of CCBE1, CORO6, NEURL1, and RDH12 were significantly higher in N+ compared to N- OSCC patients.

3.4. Development and Validation of a Machine Learning Model to Predict LNM of OSCC

Based on clinical N and seven candidate RNAs, we established a prediction model for LNM of OSCC. The machine learning was carried out, including LR, SVM, RF, and XGBoost. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy area under the curve (AUC) mean value, and 95% confidence interval (CI) are shown in Table 2. From the result, the average of the accuracy rate of the machine learning model was 0.79 and the AUC value was 0.84, indicating that the model had optimal performance. Based on the machine learning model, the receiver operating curves (ROCs) were depicted in the training set, test set, and entire data (Figure 6). The AUCs were 0.9773, 0.8441, and 0.8558, respectively, suggesting the good prediction efficiency of the model. As shown in Figure 7, a nomogram was established to predict the risk for LNM in OSCC. Logistic regression analysis revealed that the clinical N stage () was an important factor to predict LNM of OSCC. Furthermore, three DERNAs including RDH12 ( value < 0.05), CCBE1 ( value < 0.01), and AL162581.1 ( value < 0.05) possessed potential value as predictive biomarkers for LNM in OSCC patients.

The following two logistic regression models were established, with cN as the predictor and pN as the outcome; the other was a multiple logistic regression model (complex), with cN and characteristic RNA expression levels as predictors and pN as the outcome. In Figure 8(a), a decision curve showed that using the RNA nomogram in the current study to predict the LNM added was more beneficial than only using the clinical N stage. As shown in Figures 8(b) and 8(c), our clinical impact curves draw the clinical influence curves of the cN model and the complex model, respectively. The simple model to predict the risk stratification of 100 patients displayed the “cost : benefit ratio” -axis, assigned 8 scales, and showed the confidence interval. The red curve (number of high risk) represented the number of people who were classified as positive (high risk) by the cN model or the complex model at each threshold probability, and the blue curve (number of high risk with outcome) was the number of true positives at each threshold probability.

4. Discussion

LNM is the main reason for the failure of OSCC treatment, which will significantly reduce patients’ survival rate [22, 23]. Once cervical LNM is detected during follow-up, cervical lymph node dissection does not always save the patient, and sometimes, the rescue rate is less than 40% [24]. At the same time, 60%-80% of END patients are evaluated as cN0 and no metastasis, but unnecessary cervical lymphadenectomy is required, which causes shoulder and neck pain and dysfunction, thereby affecting long-term quality of life (QOL) [25, 26]. Therefore, there is an urgent need to identify patients who can obtain greater benefits from END and to avoid unnecessary LN-related surgery in patients without LNM, especially in relatively early-stage T patients. The limitation of diagnostic imaging technology (including ultrasound, computed tomography (CT), and magnetic resonance imaging (MRI) is that LN status cannot be fully predicted. To date, many efforts have been made to develop diagnostic biomarkers for LNM in OCSS patients. However, most of these markers are limited by their detection potential.

Recent developments in technology of whole-transcriptome sequencing provide a possibility to develop new biomarkers and therapeutic strategies in most types of human cancers [8, 9]. In this study, we identified 139 DERNAs between non-LNM and LNM OSCC. These DEmRNAs were distinctly involved in several key pathways such as “regulation of striated muscle contraction,” “regulation of muscle system process,” and “muscle filament sliding,” indicating that these genes could be involved in LNM of OSCC. Based on DEGs, Sonohara et al. proposed a novel gene-expression signature for prediction of lymph node metastasis in esophageal squamous cell carcinoma (ESCC) patients by analyzing RNA-sequencing profiles [27]. Daisuke et al. constructed a 15-gene signature for detection of lymph node metastasis in early-stage gastric cancer (GC) patients by using the genome-wide transcriptomic approach [28]. With regard to OSCC, Pasini et al. developed a four-gene expression model to predict LNM in OSCC, but their results showed a 22% false positive rate in pN0 cases, which may lead to over treatment [29]. In the present study, we constructed an RNA-seq-based nomogram combined with clinicopathological factors. This model was composed of NEURL1, AL162581.1 (miscRNA), AP002336.2 (lncRNA), CCBE1, CORO6, RDH12, and AC129492.6 (pseudogene). These candidate DERNAs could significantly distinguish non-LNM and LNM of OSCC. Among them, CCBE1, CORO6, NEURL1, and RDH12 were significantly higher in N+ compared to N- OSCC patients in the GSE9844 dataset. More importantly, RDH12, CCBE1, and AL162581.1 were significantly associated with OSCC LNM. As per previous studies, CCBE1 is indispensable for the development of lymphatic vessels which have important roles in lymphangiogenesis and cancer metastasis [30]. Tumor lymphangiogenesis plays an important role in LNM of OSCC [31–33]. Hogan et al. suggested that CCBE1 may be an extracellular guidance molecule and an independent factor for normal lymphoblasts to germinate or even migrate [34]. Peng et al. concluded that CCBE1 had potential to be a biomarker for prediction of LNM in lung cancer patients because its expression was decreased in lung tumor tissue and further downregulated in patients with LNM [35]. Leong et al. found that CCBE1 as a direct target could promote invasion and metastasis of breast cancer [36]. Our research showed that analysis of CCBE1 expression in the OSCC tissues may help surgeons to evaluate the LNM risk, and CCBE1 might become a potentially therapeutic biomarker in OSCC. Further research is required to understand more about the function of CCBE1 in the LNM of OSCC.

Previous studies have shown that various clinicopathological predictors and genes are considered as risk factors for LNM in the patients with OSCC [37, 38]. However, no study has combined a visual presentation nomogram with these risk factors. The nomogram is a visualization of a statistical model specifically developed to optimize the accuracy of individual prediction. The preoperative nomogram of estimated LNM can help surgeons identify patients who can obtain greater benefit from a more extensive operation [39–41]. Compared with traditional multiple regression models, the advantage of the nomogram is that all key predictors are displayed graphically. Therefore, we established and validated a novel clinically useful nomogram based on RNA-seq combined with clinicopathological factors to predict the LNM of patients with OSCC. The AUC of the model was up to 0.9773 in the training set, suggesting that the model exhibited a good performance to predict LNM of OSCC. After validation by the test and entire sets, the model still possessed high sensitivity and accuracy on prediction of LNM of OSCC. Thus, the model established by comprehensive use of clinical features had good performance, and candidate RNAs were superior to the use of certain indicators alone, indicating the clinical practicality and innovation of our research. To further validate the prediction efficiency of the model on OSCC LNM, we conducted logistic regression models. As expected, the RNA nomogram combining the clinical N stage showed higher accuracy to predict LNM compared to only the clinical N stage.

At present, some studies have identified some individual markers for LNM in OCSS patients based on microarrays, which require separate clinical tests and individual clinical tests, resulting in increased costs [39–41]. The microarray technology used in those studies does not reflect current genomic views because it can only detect protein-coding genes. Combining protein-coding genes and noncoding genes may improve the robustness of molecular biomarkers. RNA-seq clinical tools have key advantages over other platforms. The bias and limitations of microarray data are improved by RNA-seq, especially in the detection of low-abundance transcripts. This advantage of RNA-seq can be translated into a better correlation with qPCR data in laboratory and patient samples, which is especially important for genes that tend to be differentially expressed but have low absolute abundance. Moreover, RNA-seq provides comprehensive expression data, which will become increasingly important in understanding and predicting the therapeutic response of most tumors that lack classic targetable changes. Our prediction model is based on the RNA-seq dataset. This method is more economical and more clinically applicable than whole-genome sequencing. Our findings constructed an RNA-seq-based nomogram combined with clinical pathology, which may provide clinicians with useful tools for preoperative prediction of LNM and tailor-made personalized treatment for OSCC patients. It is easy to understand its graphical scoring system, which helps to customize treatment and medical decisions. To the best of our knowledge, the RNA-seq-based nomogram described in this article has not been reported previously, providing a powerful prognostic tool for precision oncology. Therefore, this model may have important implications for clinical practice. Our RNA-seq data is based on the TCGA database and the study population is from different races, so the model can be extended to other races/ethnic populations. The RNA-seq-based nomogram combined with clinicopathology provides an opportunity for individualized adjuvant therapy based on biological factors and comprehensive change testing through the RNA-seq platform. Therefore, this model may be a clinically useful tool that can be easily incorporated into the RNA-seq clinical sequencing program to personalize OSCC treatment.

However, our study had certain limitations. We acknowledged that it was based on TCGA data and the sample size was relatively small. In addition, the nomogram had only been validated internally and still needed to be further validated by independent cohorts in a multicenter trial to investigate whether the results are applicable to other populations.

5. Conclusion

The RNA-seq-based nomogram combined with clinicopathology could potentially provide clinicians with a useful tool to best select patients with LNM who will benefit from neck dissection, while avoiding the cost and overtreatment of those without LNM. Ultimately, optimized individually tailored therapy will contribute to the management of OSCC patients based on the model.

Abbreviations

LNM:	Lymph node metastasis
OSCC:	Oral squamous cell carcinoma
non-LNM:	Without LNM
cN0:	Clinically negative neck
END:	Elective neck dissection
TCGA:	The Cancer Genome Atlas database
GEO:	Gene Expression Omnibus
OTSCC:	Oral tongue squamous cell carcinoma
DERNAs:	Differentially expressed RNAs
FC:	Fold change
cN:	Clinical N stage
SVM:	Support vector machine
AUC:	Area under the curve
LR:	Logistic regression
RF:	Random forest
N-:	Pathological examination without lymph node metastasis
N+:	Pathological examination with lymph node metastasis
HR:	Hazard ratio
CI:	Confidence interval
PPV:	Positive predictive value
NPV:	Negative predictive value.

Data Availability

The datasets analyzed during the current study are available from the corresponding author on reasonable request.

Conflicts of Interest

We have no conflicts of interest.

Authors’ Contributions

Bo Qiao and Min Zhao contributed equally to this work.

Acknowledgments

The main results published here are based on data generated by TCGA (http://cancergenome.nih.gov). We are grateful to TCGA for the convenient source of data. This work was funded by the Chinese People’s Liberation Army General Hospital Medical Big Data Project (No. 2019MBD-003).

Supplementary Materials

Supplementary Table 1: 139 differentially expressed mRNAs between non-LNM and LNM of OSCC. (Supplementary materials)

References

A. I. Lorenzo-Pouso, M. Gallas-Torreira, M. Pérez-Sayáns et al., “Prognostic value of CAIX expression in oral squamous cell carcinoma: a systematic review and meta-analysis,” Journal of Enzyme Inhibition and Medicinal Chemistry, vol. 35, no. 1, pp. 1258–1266, 2020.
View at: Publisher Site | Google Scholar
Q. Fang, H. Gao, Q. Gao et al., “Elective neck dissection versus wait-and-see policy in cT1N0 buccal squamous cell carcinoma,” BMC Cancer, vol. 20, no. 1, p. 537, 2020.
View at: Publisher Site | Google Scholar
C. C. Stoop, R. Bree, A. J. W. P. Rosenberg, J. T. M. Gemert, T. Forouzanfar, and E. M. Van Cann, “Locoregional recurrence rate and disease-specific survival following marginal vs segmental resection for oral squamous cell carcinoma with mandibular bone invasion,” Journal of Surgical Oncology, vol. 122, no. 4, pp. 646–652, 2020.
View at: Publisher Site | Google Scholar
M. F. van der Kamp, F. O. W. Muntinghe, R. S. Iepsma et al., “Predictors for distant metastasis in head and neck cancer, with emphasis on age,” European Archives of Oto-Rhino-Laryngology, 2020.
View at: Publisher Site | Google Scholar
C.-T. Liao, J. T.-C. Chang, H.-M. Wang et al., “Survival in squamous cell carcinoma of the oral cavity,” Cancer, vol. 110, no. 3, pp. 564–571, 2007.
View at: Publisher Site | Google Scholar
A. K. D’Cruz, R. Vaish, N. Kapre et al., “Elective versus therapeutic neck dissection in node-negative oral cancer,” New England Journal of Medicine, vol. 373, no. 6, pp. 521–529, 2015.
View at: Publisher Site | Google Scholar
A. M. Bur, A. Holcomb, S. Goodwin et al., “Machine learning to predict occult nodal metastasis in early oral squamous cell carcinoma,” Oral Oncology, vol. 92, pp. 20–25, 2019.
View at: Publisher Site | Google Scholar
R. Akbani, P. K. S. Ng, H. M. J. Werner et al., “A pan-cancer proteomic perspective on The Cancer Genome Atlas,” Nature Communications, vol. 5, no. 1, 2014.
View at: Publisher Site | Google Scholar
M. Cieślik and A. M. Chinnaiyan, “Cancer transcriptome profiling at the juncture of clinical translation,” Nature Reviews Genetics, vol. 19, no. 2, pp. 93–109, 2018.
View at: Publisher Site | Google Scholar
H. Ye, T. Yu, S. Temam et al., “Transcriptomic dissection of tongue squamous cell carcinoma,” BMC Genomics, vol. 9, no. 1, p. 69, 2008.
View at: Publisher Site | Google Scholar
M. I. Love, W. Huber, and S. Anders, “Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2,” Genome Biology, vol. 15, no. 12, p. 550, 2014.
View at: Publisher Site | Google Scholar
G. Bindea, J. Galon, and B. Mlecnik, “CluePedia Cytoscape plugin: pathway insights using integrated experimental and in silico data,” Bioinformatics, vol. 29, no. 5, pp. 661–663, 2013.
View at: Publisher Site | Google Scholar
G. Bindea, B. Mlecnik, H. Hackl et al., “ClueGO: a Cytoscape plug-in to decipher functionally grouped gene ontology and pathway annotation networks,” Bioinformatics, vol. 25, no. 8, pp. 1091–1093, 2009.
View at: Publisher Site | Google Scholar
P. Shannon, A. Markiel, O. Ozier et al., “Cytoscape: a software environment for integrated models of biomolecular interaction networks,” Genome Research, vol. 13, no. 11, pp. 2498–2504, 2003.
View at: Publisher Site | Google Scholar
M. B. Kursa and W. R. Rudnicki, “Feature selection with theBorutaPackage,” Journal of Statistical Software, vol. 36, no. 11, 2010.
View at: Publisher Site | Google Scholar
L. Breiman, “Random Forests,” Machine Learning, vol. 45, pp. 5–32, 2001.
View at: Google Scholar
M. Awad and R. Khanna, “Support Vector Machines for Classification,” in Efficient Learning Machines: Theories, Concepts, and Applications for Engineers and System Designers, pp. 39–66, Apress, Berkeley, CA, 2015.
View at: Google Scholar
T. Chen and C. Guestrin, “XGBoost: A Scalable Tree Boosting System,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, NY, USA, 2016.
View at: Publisher Site | Google Scholar
E. Nunez, E. W. Steyerberg, and J. Nunez, “Regression modeling strategies,” Revista espanola de cardiologia, vol. 64, pp. 501–507, 2011.
View at: Google Scholar
D. J. Williams and J. D. Walker, “A nomogram for calculating the maximum dose of local anaesthetic,” Anaesthesia, vol. 69, pp. 847–853, 2014.
View at: Publisher Site | Google Scholar
A. J. Vickers and E. B. Elkin, “Decision curve analysis: a novel method for evaluating prediction models,” Medical Decision Making, vol. 26, pp. 565–574, 2006.
View at: Publisher Site | Google Scholar
Y. C. Lim, J. S. Lee, B. S. Koo, S.-H. Kim, Y.-H. Kim, and E. C. Choi, “Treatment of contralateral N0 neck in early squamous cell carcinoma of the oral tongue: elective neck dissection versus observation,” The Laryngoscope, vol. 116, no. 3, pp. 461–465, 2006.
View at: Publisher Site | Google Scholar
E. M. Iype, P. Sebastian, A. Mathew, P. G. Balagopal, B. T. Varghese, and S. Thomas, “The role of selective neck dissection (I–III) in the treatment of node negative (N0) neck in oral cancer,” Oral Oncology, vol. 44, no. 12, pp. 1134–1138, 2008.
View at: Publisher Site | Google Scholar
W. K. Wong and R. P. Morton, “Elective management of cervical and parotid lymph nodes in stage N0 cutaneous squamous cell carcinoma of the head and neck: a decision analysis,” European Archives of Oto-Rhino-Laryngology, vol. 271, no. 11, pp. 3011–3019, 2014.
View at: Publisher Site | Google Scholar
P. J. Bradley, A. Ferlito, C. E. Silver et al., “Neck treatment and shoulder morbidity: still a challenge,” Head & Neck, vol. 33, no. 7, pp. 1060–1067, 2011.
View at: Publisher Site | Google Scholar
S. N. Rogers, A. Ferlito, P. K. Pellitteri, A. R. Shaha, and A. Rinaldo, “Quality of life following neck dissections,” Acta Oto-Laryngologica, vol. 124, no. 3, pp. 231–236, 2014.
View at: Publisher Site | Google Scholar
F. Sonohara, F. Gao, N. Iwata et al., “Genome-wide discovery of a novel gene-expression signature for the identification of lymph node metastasis in esophageal squamous cell carcinoma,” Annals of Surgery, vol. 269, no. 5, pp. 879–886, 2019.
View at: Publisher Site | Google Scholar
D. Izumi, F. Gao, S. Toden et al., “A genomewide transcriptomic approach identifies a novel gene expression signature for the detection of lymph node metastasis in patients with early stage gastric cancer,” EBioMedicine, vol. 41, pp. 268–275, 2019.
View at: Publisher Site | Google Scholar
F. S. Pasini, S. Maistro, I. Snitcovsky et al., “Four-gene expression model predictive of lymph node metastases in oral squamous cell carcinoma,” Acta Oncologica, vol. 51, no. 1, pp. 77–85, 2011.
View at: Publisher Site | Google Scholar
J. Song, W. Chen, X. Cui et al., “CCBE1 promotes tumor lymphangiogenesis and is negatively regulated by TGFβ signaling in colorectal cancer,” Theranostics, vol. 10, no. 5, pp. 2327–2341, 2020.
View at: Publisher Site | Google Scholar
S. H. Wang, G. G. Liou, S. H. Liu et al., “Laminin γ2-enriched extracellular vesicles of oral squamous cell carcinoma cells enhance in vitro lymphangiogenesis via integrin α3-dependent uptake by lymphatic endothelial cells,” International Journal of Cancer, vol. 144, no. 11, pp. 2795–2810, 2019.
View at: Publisher Site | Google Scholar
Y. L. Chen, W. L. Wu, C. W. Jang et al., “Interferon-stimulated gene 15 modulates cell migration by interacting with Rac1 and contributes to lymph node metastasis of oral squamous cell carcinoma cells,” Oncogene, vol. 38, no. 23, pp. 4480–4495, 2019.
View at: Publisher Site | Google Scholar
A. C. Chang, M. Y. Lien, M. H. Tsai, C. H. Hua, and C. H. Tang, “WISP-1 promotes epithelial-mesenchymal transition in oral squamous cell carcinoma cells via the miR-153-3p/snail axis,” Cancers (Basel), vol. 11, no. 12, p. 1903, 2019.
View at: Publisher Site | Google Scholar
B. M. Hogan, F. L. Bos, J. Bussmann et al., “ccbe1 is required for embryonic lymphangiogenesis and venous sprouting,” Nature Genetics, vol. 41, no. 4, pp. 396–398, 2009.
View at: Publisher Site | Google Scholar
P. Li, Z. Cong, Y. Qiang et al., “Clinical significance of CCBE1 expression in lung cancer,” Molecular Medicine Reports, vol. 17, pp. 2107–2112, 2018.
View at: Google Scholar
A. Mesci, X. Huang, S. Taeb et al., “Targeting of CCBE1 by miR-330-3p in human breast cancer promotes metastasis,” British Journal of Cancer, vol. 116, no. 10, pp. 1350–1357, 2017.
View at: Publisher Site | Google Scholar
K. Miyaguchi, N. Uzawa, K. Mogushi et al., “Loss of NKX3-1 as a potential marker for an increased risk of occult lymph node metastasis and poor prognosis in oral squamous cell carcinoma,” International Journal of Oncology, vol. 40, no. 6, pp. 1907–1914, 2012.
View at: Publisher Site | Google Scholar
M. Seki, T. Sano, S. Yokoo, and T. Oyama, “Tumour budding evaluated in biopsy specimens is a useful predictor of prognosis in patients with cN0 early stage oral squamous cell carcinoma,” Histopathology, vol. 70, no. 6, pp. 869–879, 2017.
View at: Publisher Site | Google Scholar
Y. Hayashi, L. Xiao, A. Suzuki et al., “A nomogram associated with high probability of malignant nodes in the surgical specimen after trimodality therapy of patients with oesophageal cancer,” European Journal of Cancer, vol. 48, no. 18, pp. 3396–3404, 2012.
View at: Publisher Site | Google Scholar
A. M. Thompson, R. M. Turner, A. Hayen et al., “A preoperative nomogram for the prediction of ipsilateral central compartment lymph node metastases in papillary thyroid cancer,” Thyroid, vol. 24, no. 4, pp. 675–682, 2014.
View at: Publisher Site | Google Scholar
V. P. Balachandran, M. Gonen, J. J. Smith, and R. P. DeMatteo, “Nomograms in oncology: more than meets the eye,” The Lancet Oncology, vol. 16, no. 4, pp. e173–e180, 2015.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Bo Qiao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

891

Downloads

1133

Citations