Development and External Validation of Web-Based Models to Predict the Prognosis of Remnant Gastric Cancer after Surgery: A Multicenter Study

Chen, Qi-Yue; Zhong, Qing; Zhou, Jun-Feng; Qiu, Xian-Tu; Dang, Xue-Yi; Cai, Li-Sheng; Su, Guo-Qiang; Xu, Dong-Bo; Liu, Zhi-Yu; Li, Ping; Guo, Kai-Qing; Xie, Jian-Wei; Chen, Qiu-Xian; Wang, Jia-Bin; Li, Teng-Wen; Lin, Jian-Xian; Lin, Shuang-Ming; Lu, Jun; Cao, Long-Long; Lin, Mi; Tu, Ru-Hong; Huang, Ze-Ning; Lin, Ju-Li; Lin, Wei; He, Qing-Liang; Zheng, Chao-Hui; Huang, Chang-Ming

doi:https://doi.org/10.1155/2019/6012826

Journal of Oncology

On this page

Abstract Introduction Materials and Methods Results Discussion Data Availability Ethical Approval Consent Conflicts of Interest Authors’ Contributions Acknowledgments Supplementary Materials References Copyright Related Articles

Research Article | Open Access

Volume 2019 | Article ID 6012826 | https://doi.org/10.1155/2019/6012826

Development and External Validation of Web-Based Models to Predict the Prognosis of Remnant Gastric Cancer after Surgery: A Multicenter Study

Qi-Yue Chen,^1,2Qing Zhong,^1,2Jun-Feng Zhou,³Xian-Tu Qiu,⁴Xue-Yi Dang,⁵Li-Sheng Cai,⁶Guo-Qiang Su,⁷Dong-Bo Xu,⁸Zhi-Yu Liu,^1,2Ping Li,^1,2Kai-Qing Guo,⁵and Jian-Wei Xie^1,2 et al.

Academic Editor: Stefano Cascinu

Received19 Dec 2018

Accepted13 Feb 2019

Published10 Apr 2019

Abstract

Background. Remnant gastric cancer (RGC) is a rare malignant tumor with poor prognosis. There is no universally accepted prognostic model for RGC. Methods. We analyzed data for 253 RGC patients who underwent radical gastrectomy from 6 centers. The prognosis prediction performances of the AJCC7th and AJCC8th TNM staging systems and the TRM staging system for RGC patients were evaluated. Web-based prediction models based on independent prognostic factors were developed to predict the survival of the RGC patients. External validation was performed using a cohort of 49 Chinese patients. Results. The predictive abilities of the AJCC8th and TRM staging systems were no better than those of the AJCC7th staging system (c-index: AJCC7th vs. AJCC8th vs. TRM, 0.743 vs. 0.732 vs. 0.744; P>0.05). Within each staging system, the survival of the two adjacent stages was not well discriminated (P>0.05). Multivariate analysis showed that age, tumor size, T stage, and N stage were independent prognostic factors. Based on the above variables, we developed 3 web-based prediction models, which were superior to the AJCC7th staging system in their discriminatory ability (c-index), predictive homogeneity (likelihood ratio chi-square), predictive accuracy (AIC, BIC), and model stability (time-dependent ROC curves). External validation showed predictable accuracies of 0.780, 0.822, and 0.700, respectively, in predicting overall survival, disease-specific survival, and disease-free survival. Conclusions. The AJCC TNM staging system and the TRM staging system did not enable good distinction among the RGC patients. We have developed and validated visual web-based prediction models that are superior to these staging systems.

1. Introduction

Remnant gastric cancer (RGC) encompasses all carcinomas arising in the remnant stomach following gastrectomy, irrespective of the histology of the primary disease (benign or malignant) or the extent of resection, the method of reconstruction, and nonrestriction of the time interval [1]. It has been reported that the incidence of RGC accounts for 1-3% of GC. Although the surgical treatment of patients with benign gastric diseases has decreased, the early detection of primary gastric cancer (PGC) and the improvement of the prognosis of patients with PGC have led to an increase of the incidence of RGC [2–4]. Compared with PGC, the diagnosis of RGC generally occurs at later stages, resulting in poor prognosis [3]. Therefore, the development of effective prognostic risk stratification for such rare patients has become a research hotspot.

The continuous update and improvement of the AJCC (American Joint Committee on Cancer) TNM staging are particularly conspicuous [5, 6], as this is generally accepted as an ideal prognostic evaluation system for PGC. However, the number of lymph nodes retrieved (RLNs) in RGC is lower than that in PGC, especially in patients with initial GC. Several studies have shown that the AJCC TNM staging of PGC cannot be fully applied to evaluate the prognosis of RGC, and the survival between stages is not completely distinguishable [7–9]. Recently, the rate of LN metastasis (LNR; the ratio of positive LNs to RLNs) is considered more suitable for evaluating LN status in PGC patients with fewer retrieved LNs than positive LNs. The TRM (tumor-ratio-metastasis) staging derived from the LNR is considered a good supplement to the TNM staging system [10–12]. However, the TRM staging system is still affected by the number of lymph nodes, and the value of RGC remains questionable.

Nomograms are multivariable survival prediction models based on individual patient characteristics and are widely used in the cancer field because they can provide individualized patient survival predictions [13, 14]. Although many nomograms of PGC have been reported [15–17], an RGC nomogram has not yet been reported. What is more, the calculation process of conventional nomogram is rather complex in clinical practice, which is not conducive to large-scale popularization and promotion, especially for patients. As we enter the era of personalized medicine, web-based nomograms are a way of visualizing nomograms that is more practical and easy to popularize [18, 19]. Therefore, based on multicenter data, the purpose of this study was to evaluate the prognosis prediction performance of the AJCC 7th TNM staging system, the AJCC 8th TNM staging system, and the TRM staging system and to establish a new web-based prognosis prediction model for RGC, thus providing an individualized, simple, and practical clinical prognostic assessment tool for this special group of GC patients.

2. Materials and Methods

2.1. Population and Covariates

For the purposes of the present study, RGC was defined as all newly diagnosed gastric cancers in the remnant stomach after partial gastrectomy regardless of the original disease. From January 2003 to January 2017, 322 patients with a history of gastrectomy were identified, including 283 patients from Fujian Medical University Union Hospital, the First Affiliated Hospital of Fujian Medical University, Zhangzhou Affiliated Hospital of Fujian Medical University, and Longyan First Affiliated Hospital of Fujian Medical University. 8 patients had been treated at the First Affiliated Hospital of Xiamen University, and 31 patients had been treated at Shanxi Provincial Cancer Hospital. The inclusion criteria were defined as follows: the presence of remnant GC, no combined malignancy, no preoperative chemotherapy and/or radiotherapy, no distant metastasis, and complete basic patient information. Exclusion criteria were defined as follows: histology showing a tumor type other than adenocarcinoma or a lack of either patient death or patient survival data. The remaining 253 patients who underwent surgery for RGC were included in the present study. The institutional review boards of all participating institutions approved the study.

The Roux-en-Y method was performed for reconstruction. Adjuvant chemotherapy was recommended to patients with Stage II or greater, according to the TNM stage for primary gastric cancer as described at that time. All patients received standard postoperative follow-up care from the participating centers, including visits every 3-6 months for the first 2 years, every 6-12 months from the 3rd to 5th year, and annually thereafter. All patients were observed until death or the final follow-up in May 2018.

2.1.1. TNM and TRM Staging

Pathological (p) T and N stages were classified according to the 7th and 8th editions of the AJCC TNM staging system (T1: mucosa or submucosa, T2: proper muscle, T3: subserosa, T4a: serosa invasion, T4b: adjacent organ invasion; N0: no LN metastasis, N1: 1–2 metastatic LNs, N2: 3–6 metastatic LNs, N3a: 7–15 metastatic LNs, N3b: 16 or more metastatic LNs) [5, 6]. LNR was defined as the metastatic LN count divided by the RLN. The cutoff points for LNR were considered using the best cutoff approach and balancing the number of each classification as well as considering each patient’s survival (using Kaplan–Meier curves). In the current study, novel cutoff values of LNR were determined as 0.3 and 0.6 based on overall survival using the software X-tile (Supplemental Figure 1). Node ratio (Nr) groups were categorized according to the cutoffs as follows: Nr0: 0; Nr1: 0 < LNR ≤ 0.3; Nr2: 0.3 < LNR ≤ 0.6; Nr3: 0.6 < LNR. A new staging system, named TRM, was constructed based on the same pT and M definitions from the 7th AJCC staging system (Supplemental Figure 2).

2.2. Statistical Analysis

Overall survival (OS) was defined as time from surgery to death from any cause, disease-specific survival (DSS) was defined as time from surgery to death from cancer, and disease-free survival (DFS) was defined as the time from surgery to the time of recurrence or death from any cause. Survival curves were estimated using the Kaplan–Meier method, and the log-rank test was used to determine significance.

Variables associated with OS, DSS, and DFS were selected using multivariate Cox regression models. Stepwise backward variable removal was applied to the multivariate model to identify the most accurate and parsimonious set of predictors [20]. For purposes of illustration and clinical applicability, three web-based nomograms were created based on the final regression model.

The performance of a prognostic system has been shown to be related to homogeneity (small differences in survival among patients in the same class within each system) and discriminatory ability (greater differences in survival among patients in different stages within each system). Harrell’s c-index was used to measure the discriminatory ability of different prognostic systems [21, 22]. The likelihood ratio chi-square score was calculated using Cox regression to measure homogeneity; a higher likelihood ratio chi-square score indicates better homogeneity [23]. We used the Akaike information criterion (AIC) within the Cox regression model to compare performances between 2 prognostic systems; smaller AIC values represent better optimistic prognostic stratification [24]. We calculated the relative likelihood of two models using the formula: exp((AIC (model A) -AIC (model B))/2). The relative likelihood represents the probability that model A minimizes information as effectively as model B and can thus be interpreted as a P value for the comparison of both AIC values [25]. Calibration plots were generated to evaluate the performance characteristics of the prediction models. Receiver operating characteristic (ROC) curves were used to assess the discrimination power of the models. Decision curve analysis (DCA) was used to evaluate the clinical usefulness of the prediction models [26]. We also performed time-dependent receiver operating characteristics (time-dependent ROC) analysis to assess the discriminatory power of the prognosis model for time-dependent disease outcomes [27]. The Bayesian Information Criterion (BIC) was used to assess the overall prognostic performance of different prognostic systems via bootstrap-resampling analysis [28, 29]. External validation was performed using the Affiliated Hospital of Putian University validation cohort (PTAH; n=49; 2013-2017), which satisfied the aforementioned inclusion criteria.

All data were processed using SPSS 19.0 (SPSS Inc. Chicago, IL, USA) and R software (version 3.5.0). The R package “DynNom” was used to develop the web-based nomogram. All tests were two-sided with a significance level set to P<0.05.

3. Results

3.1. Demographic and Clinicopathologic Characteristics

The demographic and clinicopathologic characteristics of 253 RGC patients are summarized in Table 1. Among them, 79.1% of the patients were diagnosed with GC in the remnant stomach over 5 years after the primary gastrectomy. The mean age of the patients was 63.8 years (range 37-87 years), and the male-to-female ratio was 7.4:1. In total, 144 (56.9%) cases were located at the anastomosis site, and 109 (43.1%) cases were located at the nonanastomotic site. The average number of LNs examined was 16.1 (range 1–59), and 54.2% of patients had ≤15 RLN. Nearly half of patients (51%) received adjuvant chemotherapy after the RGC surgery. After a median follow-up of 64 months (1-235 months), the 5-year OS, the 5-year DSS, and the 5-year DFS after surgery were 48.39%, 53.73%, and 47.64%, respectively. A total of 87 patients in 253 patients had recurrence (34.4%), of which 24 patients had local recurrence (9.5%). 39 patients had peritoneal metastases (15.4%), and 59 patients had distant metastases (23.3%).

3.2. Survival: AJCC TNM and TRM Categories

When comparing the 7th and 8th editions of the AJCC TNM staging system (Supplemental Table 1), 79.4% (n=201) of patients had the same staging in both staging systems, and the stages of 20.6% (n=52) of the patients differed between the systems. Furthermore, the comparison of the AJCC 7th staging system and the TRM staging system revealed that the tumor staging differed for 56 patients (22.1%) (Supplemental Table 2). The OS, DSS, and DFS of the three staging systems are shown in Figure 1. For the AJCC 7th staging system, the 5-year OS of Ia, Ib, IIa, IIb, IIIa, IIIb, and IIIc were 86.4%, 86.7%, 71.4%, 56.5%, 49.0%, 24.2%, and 24.1%, respectively (P<0.05). For the AJCC 8th staging system, the 5-year OS of Ia, Ib, IIa, IIb, IIIa, IIIb, and IIIc were 86.4%, 86.7%, 71.4%, 56.5%, 37.0%, 24.4%, and 20.0%, respectively (P<0.05). Moreover, the 5-year OS of Ia, Ib, IIa, IIb, IIIa, IIIb, and IIIc for the TRM staging system were 86.4%, 87.1%, 70.6%, 54.2%, 40.0%, 27.3%, and 18.8%, respectively (P<0.05). Further subgroup analysis showed no significant difference in OS between adjacent stages (P>0.05), except for IIIa and IIIb in the AJCC 7th staging system (P=0.011). Additionally, in the AJCC 8th staging system, other than IIb and IIIa (P=0.024), the OS of the adjacent groups could not be distinguished (P>0.05). In addition, there was no significant difference in the OS of adjacent stages (P>0.05), except for IIa and IIb in the TRM staging system (P=0.049). Similarly, there was no good distinction between two adjacent stages of the AJCC 8th and TRM staging systems for DSS and DFS.

(a)

(b)

(c)

3.3. Development of Prediction Models

Univariate analysis demonstrated that several factors were related to OS (Table 2), including age (P=0.015), lymphovascular invasion (P<0.001), combined resection (P=0.029), histology (P=0.002), macroscopic type (P<0.001), tumor size (P=0.003), pT stage (P<0.001), pN stage (P<0.001), and adjuvant chemotherapy (P=0.008). After stepwise backward variable selection, age, tumor size, T stage, and N stage were found to be independent prognostic factors for OS in the multivariate analysis. Based on the above four variables, we developed a web-based nomogram (the Huang OS model, https://zhongqing.shinyapps.io/HuangOSmodel/) for the individualized prediction of the OS of RGC patients (Figure 2). Meanwhile, multivariate analysis also showed that the independent prognostic factors of DSS and DFS were age, tumor size, T stage, and N stage. Based on the final regression models, we also established two web-based nomograms (the Huang DSS model, https://zhongqing.shinyapps.io/HuangDSSmodel/, Figure 3, and the Huang DFS model, https://zhongqing.shinyapps.io/HuangDFSmodel/, Supplemental Figure 3) to accurately predict RGC patients’ DSS and DFS.

(a)

(b)

(c)

(d)

(e)

(f)

Figure 2

(a) The Huang OS model (a web-based OS nomogram) for predicting 3- and 5-year OS rates for RGC. The nomogram is used by summing the points identified on the point scale for each variable. The total points projected on the bottom scales indicate the probability of 3- and 5-year OS. The nomogram is available at https://zhongqing.shinyapps.io/HuangOSmodel/. To use this nomogram, choose the value for each variable and the predicted survival time; then press the “predict” button. (b) A calibration plot of the web-based nomogram for 3 years and 5 years. (c) The receiver operating characteristic (ROC) curves for the 3- and 5-year overall survival probability for the web-based nomogram and the 3 studied staging systems. (d) Decision curve analysis (DCA) for the 3-year OS and 5-year OS after surgery. The y-axis measures the net benefit. (e) Time-dependent ROC curves for the web-based nomogram and the 3 studied staging systems. The x-axis represents the year after surgery, and the y-axis represents the estimated area under the ROC curve for survival at the time of interest. (f) The results from a bootstrap analysis (1,000 samples): mean differences in Bayesian information criteria (BIC) with 95% confidence limits, including the web-based nomogram and the 3 studied staging systems.

(a)

(b)

(c)

(d)

(e)

(f)

Figure 3

(a) The Huang DSS model (a web-based DSS nomogram) for predicting 3- and 5-year DSS rates for RGC. The nomogram is used by summing the points identified on the point scale for each variable. The total points projected on the bottom scales indicate the probability of 3- and 5-year DSS. The nomogram is available at https://zhongqing.shinyapps.io/HuangDSSmodel/. To use this nomogram, choose the value for each variable and the predicted survival time; then press the “predict” button. (b) A calibration plot of the web-based nomogram for 3 years and 5 years. (c) The receiver operating characteristic (ROC) curve for the 3- and 5-year disease-specific survival probability for the web-based nomogram and the 3 studied staging systems. (d) DCA for 3-year DSS and 5-year DSS after surgery. The y-axis measures the net benefit. (e) Time-dependent ROC curves for the web-based nomogram and the 3 studied staging systems. The x-axis represents the year after surgery, and the y-axis represents the estimated area under the ROC curve for survival at the time of interest. (f) The results from a bootstrap analysis (1,000 samples): mean differences in Bayesian information criteria (BIC) with 95% confidence limits, including the web-based nomogram and the 3 studied staging systems.

3.4. Comparison of the Four Prognostic Classification Systems

The predictive ability of each prognostic system is compared in Table 3. Regardless of whether OS, DSS, or DFS was compared, there was no significant difference in the prognostic discriminability (c-index) between the AJCC 8th staging and TRM staging systems when compared with the AJCC 7th staging system (P>0.05), while the Huang model was superior to the 7th AJCC staging system when comparing the c-index (Huang OS model 0.774 vs. AJCC 7th staging 0.743, p = 0.037; Huang DSS model 0.773 vs. AJCC 7th staging 0.742, p = 0.032; Huang DFS model 0.744 vs. AJCC 7th staging 0.710, p = 0.021). AIC analysis showed that the AJCC 7th staging system, the AJCC 8th staging system, and the TRM staging system possessed similar goodness of fits for OS, DSS, and DFS (relative likelihood >0.05), while the Huang model had a better goodness of fit than did the AJCC 7th staging system (relative likelihood <0.05). The Huang model also had better performance based on the likelihood ratio chi-square. Moreover, the stratification analysis confirmed that regardless of whether the number of LNs examined was more than 15 or not, the prediction performances of the web-based nomograms were better than those of the other three staging systems (Supplemental Table 3).

3.5. Validation

The nomogram calibration plot demonstrated good agreement between the predicted and observed survival rates for each of OS, DSS, and DFS (Figures 2(b) and 3(b) and Supplemental Figure 3(B)). The ROC curves showed that the prediction accuracy of the Huang model is better than those of the AJCC staging and TRM staging systems for OS, DSS, and DFS (Figures 2(c) and 3(c) and Supplemental Figure 3(C)). In addition, the DCA was used to evaluate and compare the clinical usefulness of various prognostic models (Figures 2(d) and 3(d) and Supplemental Figure 3(D)), and the results showed that the Huang model provided a better net benefit than the other three staging systems at the same probability threshold. Using time-dependent ROC curves, we compared the continuous trends of the survival hazard ratio for each staging system. As shown in Figures 2(e) and 3(e) and Supplemental Figure 3(E), the Huang model proved superior to the other three staging systems over time. BIC, a criterion that accurately considers the number of parameters included in the models, was used to assess the overall prognostic performance of the various prognostic systems. As shown in Figures 2(f) and 3(f) and Supplemental Figure 3(F), there was no significant difference between the AJCC 7th staging system and TRM staging system in the bootstrap analysis; neither was there a difference between the AJCC 7th and the AJCC 8th staging systems. However, when compared to the AJCC 7th staging system, the multivariate “Huang model” appeared to have a slight but obvious advantage. Supplemental Figure 4 illustrates the discrepancies between the two prediction methods. For each AJCC 7th stage grouping, histograms of nomogram-predicted probabilities are presented, showing the advantage of the web-based nomogram over the AJCC 7th stage groupings.

In the external validation cohort, the calibration curve of the web-based nomogram (Supplemental Figure 5) also showed good agreement between the predicted and observed outcomes. The predictive ability of the web-based prognostic model was also better than that of other 3 different staging systems in the validation cohort (Supplemental Table 5).

4. Discussion

Due to the rarity of RGC, the recent guidelines for gastric cancer, including the Japanese gastric cancer guideline, the NCCN guideline, and the ESMO guideline, mention only in their definition of RGC the tumor location in the remnant stomach and the regional LN [1, 30–32]. There is no consensus on the best prognostic staging system for RGC. The staging system of PGC is still used for RGC in clinical practice at the present time.

However, previous studies have reported that RGCs have different prognostic characteristics than PGCs [2, 4, 33, 34], and the survival of RGC patients showed significant heterogeneity. Therefore, knowing how to develop an accurate risk stratification is very important for RGC patients and clinicians. The AJCC TNM staging system, one of the most important prognostic staging systems, has become an important reference for clinical treatment decision-making and assessing the prognosis of PGC. With the cooperation of and promotion by the AJCC, UICC, and IGCA, the most recent edition of the AJCC TNM staging system, the AJCC 8th edition, was published in 2017 through the accumulation and analysis of big data. However, the practicability of the AJCC 8th staging system in RGC has not been reported. The results of this study suggest that the AJCC 8th staging system is not a significant improvement over the AJCC 7th staging system (c-index: AJCC 7th staging vs. AJCC 8th staging, OS: 0.743 vs. 0.732; DSS: 0.742 vs. 0.731; DFS: 0.710 vs. 0.700). Several studies have demonstrated that examining at least 16 LNs can provide better predictions of the prognosis of GC patients [35, 36]. Nevertheless, the local anatomy and lymphatic flow of RGC are changed by the primary operation, which results in a lower number of LN being examined and stage migration. It has been recognized that the TRM staging system can help doctors to distinguish the prognosis of PGC patients regardless of the number of LNs examined [12, 37]. However, we found that, compared with the 7th AJCC staging system, the TRM staging system did not significantly improve the ability to distinguish the prognosis of patients with RGC (c-index: AJCC 7th staging vs. TRM staging, OS: 0.743 vs. 0.744; DSS: 0.742 vs. 0.754; DFS: 0.710 vs. 0.714). More importantly, regardless of whether OS, DSS, or DFS was examined, there was no significant difference between most pairs of adjacent stages in each staging system (P>0.05).

It is possible that the staging system of PGC may not be sufficiently accurate to evaluate the prognosis of patients with RGC. Therefore, three web-based prediction models for predicting the OS, DSS, and DFS of RGC patients were established in combination with the prognostic factors. When compared with three other staging systems, the web-based prediction model was shown to improve the prediction performance in terms of the discriminatory ability (c-index), predictive homogeneity (likelihood ratio chi-square), predictive accuracy (AIC, BIC), and model stability (time-dependent ROC curves). The calibration curve and ROC curve also show that the web-based prediction models provide good prediction accuracy. In addition, the DCA also demonstrated that the Huang model could provide a greater net benefit and clinical value than the other three staging systems. Moreover, the stratified analysis showed that regardless of whether the number of LNs examined was more than 15 or not, the web-based model remained superior to the other three staging systems. External validation in the PTAH validation cohort demonstrated good discrimination power (Harrell’s c-index, 0.780, 0.822 and 0.700). Calibration using the PTAH validation cohort demonstrated that the actual survival corresponds closely to the predicted survival.

Compared to traditional staging systems, risk grouping, or nomograms, the web-based prediction model can be accessed using a personal computer or website-enabled cellular phone, which is convenient for clinicians, such that they can use it in real time to better inform the patient’s prognosis, providing great convenience and practicability. With the development of medical information technology, the web-based prediction model is also easier to popularize. Based on multicenter data, we developed the first web-based prediction model for predicting survival in RGC. This model can guide doctors in developing a personalized follow-up strategy and can become one part of a standardized disease management after RGC surgery.

At present, in East Asian countries including China, standard D2 lymph node dissection plus postoperative adjuvant chemotherapy has been the standard treatment for advanced GC for many years [32]. Based on two important phase III clinical studies, CLASSIC [38] and ACTS-GC [39], it has been confirmed that postoperative chemotherapy can improve the survival of advanced PGC. However, RCTs for gastric cancer patients often use RGC as an exclusion criterion, and there are no prospective studies for the chemotherapy of RGC. Although adjuvant chemotherapy is not an independent prognostic factor for RGC patients in this study, based on existing evidence of RGC [4], we still believe that adjuvant chemotherapy is an important therapeutic component for patients with advanced RGC. We look forward to further confirming the impact of chemotherapy on RGC survival through a multicenter prospective study.

Because GC resection is often accompanied by extensive lymphadenectomy, the route of LN metastasis in RGC patients with initial malignant disease surgery may be different from that of patients after initial benign disease surgery. Therefore, whether there is a difference in the prognosis between initial surgery for benign disease and malignant disease remains controversial. Previous studies have shown a contradictory result between the malignant and benign groups (Supplemental Table 6) [40–44]. We combined the data, which revealed that there was no significant difference between the two groups of patients in 5-year OS (45.2% vs. 41.7%). The results of this study also showed that the 5-year OS of RGC patients with initial malignant disease surgery was 48.61%, and the 5-year OS of RGC patients with initial benign disease surgery was 48.26%; there was no significant difference between the two groups (p=0.709). Although RGC in patients with primary malignancy appears earlier than in patients with primary benign disease [45], the univariate and multivariate Cox analysis in our study showed that the type of the primary disease was not an independent prognostic factor. Therefore, we believe that the web-based prediction model we have established is still applicable to most RGC patients. More in-depth analysis of prognosis of RGC between first operation for benign disease and that for malignant disease by enlarging data size is needed.

RGC is rare; this study not only assessed the prognosis predictive ability of the AJCC 7th, AJCC 8th, and TRM staging systems in patients with RGC but also established an interactive web-based prediction model for predicting the survival of RGC patients. However, our study is not without limitations. First, this study is a multicenter retrospective study, and potential bias is inevitable. Previous literature reported that many immunoinflammatory markers (e.g., NLR, PLR, and LMR) have prognostic value in PGC [46–48]. However, due to the rarity of RGC, there is no report on the influence of immunoinflammatory markers on the prognosis of RGC. Because of the limitations of our retrospective study, we did not conduct in-depth analysis of preoperative biochemical parameters. In addition, this study did not include the increasingly recognized prognostic tissue-based biomarkers (e.g., MSI) in the analysis [49, 50]. What is more, although the results obtained by incorporating data from several Chinese centers were highly universal and applicable, the number of cases was still relatively small. In addition, because of the differences in treatment patterns between the East and the West, Chinese gastric cancer patients rarely receive preoperative therapy compared with those in Europe and the United States. As is already known, preoperative chemotherapy has a chemotherapy-related downstages effect. Postoperative pathological T stage (ypT) and pathological N (ypN) stage of gastric cancer patients after preoperative therapy may have different effects on prognosis compared with the same pathological T stage (pT) and pathological N stage (pN) of patients without preoperative chemotherapy. Therefore, we did not include patients with neoadjuvant therapy to avoid the impact of neoadjuvant therapy on the accuracy of the results. Furthermore, we adopted any statistical methods to validate the web-based model and prove its excellent predictive performance; these user-friendly web-based models showed precise discriminative ability both in the development cohort and in the external validation cohort, supporting the generalizability of these nomograms. However, the sample size for validation study was small and patients were enrolled from single institute. More patient from multiple institutes might be needed for validation study. What is more, we continue to need validation from Western big data because of differences in socioeconomic status and diagnosis levels between nations. We look forward to the validation and even to the improvement of the web-based prediction model by further selecting larger and more representative data for RGC cases from a greater number of countries worldwide.

In summary, the various AJCC TNM and TRM staging systems did not distinguish the survival of patients with RGC well. We have developed and validated user-friendly web-based prediction models that are superior to the currently used staging systems. These models can accurately predict the prognosis of RGC patients and guide clinical practice.

Data Availability

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Ethical Approval

All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1964 and later versions.

Informed consent or substitute for it was obtained from all patients for being included in the study.

Conflicts of Interest

None of the authors have any conflicts of interest regarding this manuscript.

Authors’ Contributions

Huang CM, Zheng CH, Chen QY, and Zhong Q contributed to conception and design. Chen QY, Zhou JF, Qiu XT, Dang XY, Cai LS, Su GQ, Xu DB, Zhong Q, Liu ZY, Li P, G KQ, Xie JW, Chen QX, Wang JB, Li TW, Lin JX, Lin SM, Lu J, Cao LL, Lin M, Tu RH, Huang ZN, Lin JL, Lin W, He QL, Zheng CH, and Huang CM were responsible for the collection and/or assembly of data. Chen QY, Zhou JF, Qiu XT, Dang XY, Cai LS, Su GQ, Xu DB, Zhong Q, Lin W, He QL, Zheng CH, and Huang CM performed data analysis and interpretation. Chen QY, Zhou JF, Qiu XT, Dang XY, Cai LS, Su GQ, Xu DB, Zhong Q, Zheng CH, and Huang CM wrote the manuscript. All authors read and approved the final manuscript. Chen QY, Zhong Q, Zhou JF, Qiu XT, Dang XY, Cai LS, Su GQ, and Xu DB contributed equally to this work and should be considered co-first authors.

Acknowledgments

This work is supported by Scientific and Technological Innovation Joint Capital Projects of Fujian Province (2016Y9031); Construction Project of Fujian Province Minimally Invasive Medical Center (No. 171); the second batch of special support funds for Fujian Province innovation and entrepreneurship talents (2016B013); general project of Miaopu scientific research fund of Fujian Medical University (2015MP021); Youth Project of Fujian Provincial Health and Family Planning Commission (2016-1-41); Fujian Province Medical Innovation Project, Chinese Physicians Association Young Physician Respiratory Research Fund (2015-CXB-16); Fujian Science and Technology Innovation Joint Fund Project (2017Y9004). We thank Shisheng Wang and his “Wu Kong” platform for the help in statistical analysis methods.

Supplementary Materials

Supplemental Table 1. Correlation between the 7th edition and 8th edition AJCC staging systems. Supplemental Table 2. Correlation between the 7th edition AJCC staging system and the TRM staging system. Supplemental Table 3. Comparison of the prognostic performances of the 3 studied staging systems and the web-based prognostic model based on (A) a retrieved LN count ≤15 and (B) a retrieved LN count ≤15. Supplemental Table 4. Clinicopathologic description of remnant gastric cancer patients in the validation cohort. Supplemental Table 5. Comparison of the prognostic performances of the 3 studied staging systems and the web-based prognostic model in the validation cohort. Supplemental Table 6. Five-year postoperative survival rates in remnant gastric cancer between initial surgery for benign disease and initial surgery for malignant disease in previous studies. Supplemental Figure 1. X-tile analysis identifying the best cutoff points for LNR; LNR, metastatic lymph node ratio. Supplemental Figure 2. (A) The AJCC 7th staging system, (B) the TRM staging system, (C) the AJCC 8th staging system. Supplemental Figure 3. (A) The Huang DFS model (a web-based nomogram) for predicting the 3- and 5-year DFS rates for RGC. The nomogram is used by summing the points identified on the point scale for each variable. The total points projected on the bottom scales indicate the probability of 3- and 5-year DFS. The nomogram is available at https://zhongqing.shinyapps.io/Huang DFS model/. To use this nomogram, choose the value for each variable and the predicted survival time; then press the “predict” button. (B) A calibration plot of the web-based nomogram for 3 years and 5 years. (C) The receiver operating characteristic (ROC) curve for the 3- and 5-year disease-specific probability of the web-based nomogram and the 3 studied staging systems. (D) DCA for 3-year DFS and 5-year DFS after surgery. The y-axis measures the net benefit. (E) Time-dependent ROC curves for the web-based nomogram and the 3 studied staging systems. The x-axis represents the year after surgery, and the y-axis represents the estimated area under the ROC curve for survival at the time of interest. (F) The results from a bootstrap analysis (1,000 samples): mean differences in Bayesian information criteria (BIC) with 95% confidence limits for the web-based nomogram and the 3 studied staging systems. Supplemental Figure 4. Distribution of the nomogram predictions within each AJCC 7th stage grouping. The nomogram’s improved predictive ability is illustrated by the heterogeneity of the nomogram predictions. (A) Overall survival, (B) disease-specific survival, (C) disease-free survival. Supplemental Figure 5. Nomogram calibration plots using the external validation cohort. (A) Overall survival, (B) disease-specific survival, (C) disease-free survival. (Supplementary Materials)

References

T. Sano and Y. Kodera, “Japanese classification of gastric carcinoma: 3rd English edition,” Gastric Cancer, vol. 14, no. 2, pp. 101–112, 2011.
View at: Publisher Site | Google Scholar
K. Kaneko, H. Kondo, D. Saito et al., “Early gastric stump cancer following distal gastrectomy,” Gut, vol. 43, no. 3, pp. 342–344, 1998.
View at: Publisher Site | Google Scholar
M. Ohashi, H. Katai, T. Fukagawa, T. Gotoda, T. Sano, and M. Sasako, “Cancer of the gastric stump following distal gastrectomy for cancer,” British Journal of Surgery, vol. 94, no. 1, pp. 92–95, 2007.
View at: Publisher Site | Google Scholar
H. Shimada, T. Fukagawa, Y. Haga, and K. Oba, “Does remnant gastric cancer really differ from primary gastric cancer? A systematic review of the literature by the Task Force of Japanese Gastric Cancer Association,” Gastric Cancer, vol. 19, no. 2, pp. 339–349, 2016.
View at: Publisher Site | Google Scholar
S. B. Edge, “AJCC cancer staging manual,” Jama the Journal of the American Medical Association, vol. 304, pp. 1726-1727, 2010.
View at: Google Scholar
J. Doescher, J. A. Veit, and T. K. Hoffmann, “The 8th edition of the AJCC cancer staging manual: updates in otorhinolaryngology, head and neck surgery,” HNO, vol. 65, no. 12, pp. 956–961, 2017.
View at: Publisher Site | Google Scholar
F. Li, R. Zhang, H. Liang, H. Liu, J. Quan, and J. Zhao, “The pattern of lymph node metastasis and the suitability of 7th UICC N stage in predicting prognosis of remnant gastric cancer,” Journal of Cancer Research and Clinical Oncology, vol. 138, no. 1, pp. 111–117, 2012.
View at: Publisher Site | Google Scholar
M. Nakagawa, Y. Y. Choi, J. Y. An et al., “Staging for Remnant Gastric Cancer: The Metastatic Lymph Node Ratio vs. the UICC 7th Edition System,” Annals of Surgical Oncology, vol. 23, no. 13, pp. 4322–4331, 2016.
View at: Publisher Site | Google Scholar
S. Son, S. Kong, H. S. Ahn et al., “The value of N staging with the positive lymph node ratio, and splenectomy, for remnant gastric cancer: A multicenter retrospective study,” Journal of Surgical Oncology, vol. 116, no. 7, pp. 884–893, 2017.
View at: Publisher Site | Google Scholar
A. Marchet, S. Mocellin, A. Ambrosi et al., “The ratio between metastatic and examined lymph nodes (N ratio) is an independent prognostic factor in gastric cancer regardless of the type of lymphadenectomy: results from an Italian multicentric study in 1853 patients,” Annals of Surgery, vol. 245, no. 4, pp. 543–552, 2007.
View at: Publisher Site | Google Scholar
W. Wang, D. Z. Xu, Y. F. Li et al., “Tumor-ratio-metastasis staging system as an alternative to the 7th edition UICC TNM system in gastric cancer after D2 resection--results of a single-institution study of 1343 Chinese patients,” Annals of Oncology, vol. 22, no. 9, pp. 2049–2056, 2011.
View at: Publisher Site | Google Scholar
S. Kong, H. Lee, H. S. Ahn et al., “Stage Migration Effect on Survival in Gastric Cancer Surgery With Extended Lymphadenectomy,” Annals of Surgery, vol. 255, no. 1, pp. 50–58, 2012.
View at: Publisher Site | Google Scholar
A. Iasonos, D. Schrag, G. V. Raj, and K. S. Panageas, “How to build and interpret a nomogram for cancer prognosis,” Journal of Clinical Oncology, vol. 26, no. 8, pp. 1364–1370, 2008.
View at: Publisher Site | Google Scholar
V. Valentini, A. Damiani, A. Dekker et al., Statistics of survival prediction and nomogram development, Springer, Berlin, Germany, 2013.
M. W. Kattan, M. S. Karpeh, M. Mazumdar, and M. F. Brennan, “Postoperative Nomogram for Disease-Specific Survival After an R0 Resection for Gastric Carcinoma,” Journal of Clinical Oncology, vol. 21, no. 19, pp. 3647–3650, 2003.
View at: Publisher Site | Google Scholar
S. Hirabayashi, S. Kosugi, Y. Isobe et al., “Development and external validation of a nomogram for overall survival after curative resection in serosa-negative, locally advanced gastric cancer,” Annals of Oncology, vol. 25, no. 6, pp. 1179–1184, 2014.
View at: Publisher Site | Google Scholar
D. Han, Y. Suh, S. Kong et al., “Nomogram predicting long-term survival after D2 gastrectomy for gastric cancer,” Journal of Clinical Oncology, vol. 30, no. 31, pp. 3834–3840, 2012.
View at: Publisher Site | Google Scholar
M. Sanghani, P. T. Truong, R. A. Raad et al., “Validation of a web-based predictive nomogram for ipsilateral breast tumor recurrence after breast conserving therapy,” International Journal of Radiation Oncology Biology Physics, vol. 28, pp. 718–722, 2010.
View at: Google Scholar
Y. Zhang, D. Zheng, and J. Xie, “Development and validation of web-based nomograms to precisely predict conditional risk of site-specific recurrence for patients with completely resected non-small cell lung cancer: a multiinstitutional study,” Chest, 2018.
View at: Google Scholar
P. M. Grambsch and T. M. Therneau, “Proportional hazards tests and diagnostics based on weighted residuals,” Biometrika, vol. 81, no. 3, pp. 515–526, 1994.
View at: Publisher Site | Google Scholar | MathSciNet
F. E. Harrell Jr., R. M. Califf, D. B. Pryor, K. L. Lee, and R. A. Rosati, “Evaluating the yield of medical tests,” The Journal of the American Medical Association, vol. 247, no. 18, pp. 2543–2546, 1982.
View at: Publisher Site | Google Scholar
F. E. Harrell Jr., K. L. Lee, and D. B. Mark, “Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors,” Statistics in Medicine, vol. 15, no. 4, pp. 361–387, 1996.
View at: Publisher Site | Google Scholar
H. M. Yoon, K. W. Ryu, B. H. Nam et al., “Is the new seventh AJCC/UICC staging system appropriate for patients with gastric cancer?” Journal of the American College of Surgeons, vol. 214, no. 1, pp. 88–96, 2012.
View at: Publisher Site | Google Scholar
A. M. Awad, “Properties of the Akaike information criterion,” Microelectronics Reliability, vol. 36, no. 4, pp. 457–464, 1996.
View at: Publisher Site | Google Scholar
J. Edeline, J. F. Blanc, and P. Johnson, “A multicenter comparison between child pugh and albi scores in patients treated with sorafenib for hepatocellular carcinoma,” Liver International, vol. 36, pp. 1821–1828, 2016.
View at: Google Scholar
A. J. Vickers and E. B. Elkin, “Decision curve analysis: a novel method for evaluating prediction models,” Medical Decision Making, vol. 26, no. 6, pp. 565–574, 2006.
View at: Publisher Site | Google Scholar
P. J. Heagerty, T. Lumley, and M. S. Pepe, “Time‐dependent ROC curves for censored survival data and a diagnostic marker,” Biometrics, vol. 56, pp. 337–344, 2000.
View at: Google Scholar
U. Nitsche, M. Maak, T. Schuster et al., “Prediction of prognosis is not improved by the seventh and latest edition of the TNM classification for colorectal cancer in a single-center collective,” Annals of Surgery, vol. 254, no. 5, pp. 793–801, 2011.
View at: Publisher Site | Google Scholar
A. A. Neath and J. E. Cavanaugh, “The Bayesian information criterion: Background, derivation, and applications,” Wiley Interdisciplinary Reviews: Computational Statistics, vol. 4, no. 2, pp. 199–203, 2012.
View at: Publisher Site | Google Scholar
A. Okines, M. Verheij, W. Allum, D. Cunningham, and A. Cervantes, “Gastric cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up,” Annals of Oncology Official Journal of the European Society for Medical Oncology, vol. 21, Supplement 5, pp. v50–v54, 2010.
View at: Publisher Site | Google Scholar
JA. Ajani, TA. D'Amico, K. Almhanna et al., “Gastric cancer, version 3.2016, nccn clinical practice guidelines in oncology,” Journal of the National Comprehensive Cancer Network Jnccn, vol. 14, p. 1286, 2016.
View at: Google Scholar
Association JGC: Japanese gastric cancer treatment guidelines 2014 (ver. 4), Gastric Cancer Official Journal of the International Gastric Cancer Association & the Japanese Gastric Cancer Association, vol. 20, 2017.
T. Nakamura, Y. Fukai, A. Sano et al., “Remnant gastric cancer,” Annals of Oncology, vol. 46, 2012.
View at: Google Scholar
Y. Wang, C. Huang, J. Wang et al., “Survival and surgical outcomes of cardiac cancer of the remnant stomach in comparison with primary cardiac cancer,” World Journal of Surgical Oncology, vol. 12, no. 1, p. 21, 2014.
View at: Publisher Site | Google Scholar
R. E. Schwarz and D. D. Smith, “Clinical impact of lymphadenectomy extent in resectable gastric cancer of advanced stage,” Annals of Surgical Oncology, vol. 14, no. 2, pp. 317–328, 2007.
View at: Publisher Site | Google Scholar
A. Biondi, D. D'Ugo, F. C. Cananzi et al., “Does a minimum number of 16 retrieved nodes affect survival in curatively resected gastric cancer?” European Journal of Surgical Oncology the Journal of the European Society of Surgical Oncology & the British Association of Surgical Oncology, vol. 41, pp. 779–786, 2015.
View at: Google Scholar
J. Wang, P. Dang, C. P. Raut et al., “Comparison of a Lymph Node Ratio–Based Staging System With the 7th AJCC System for Gastric Cancer,” Annals of Surgery, vol. 255, no. 3, pp. 478–485, 2012.
View at: Publisher Site | Google Scholar
Y. J. Bang, Y. W. Kim, H. K. Yang et al., “Adjuvant capecitabine and oxaliplatin for gastric cancer after D2 gastrectomy (CLASSIC): a phase 3 open-label, randomised controlled trial,” Lancet, vol. 379, pp. 315–321, 2012.
View at: Google Scholar
N. Horikoshi, “Adjuvant Chemotherapy for Gastric Cancer with S-1, an Oral Fluoropyrimidine,” New England Journal of Medicine, vol. 357, pp. 1810–1820, 2007.
View at: Google Scholar
P. Lissens, L. Filez, and R. Aerts, “Surgery for gastric remnant carcinoma following Billroth II gastrectomy,” European Journal of Surgical Oncology, vol. 23, pp. 518–521, 1997.
View at: Google Scholar
X. Hu, D.-Y. Tian, L. Cao, and Y. Yu, “Progression and prognosis of gastric stump cancer,” Journal of Surgical Oncology, vol. 100, no. 6, pp. 472–476, 2009.
View at: Publisher Site | Google Scholar
T. Namikawa, H. Kitagawa, J. Iwabu, T. Okabayashi, M. Kobayashi, and K. Hanazaki, “Tumors arising at previous anastomotic site may have poor prognosis in patients with gastric stump cancer following gastrectomy,” Journal of Gastrointestinal Surgery, vol. 14, no. 12, pp. 1923–1930, 2010.
View at: Publisher Site | Google Scholar
M. Tokunaga, T. Sano, S. Ohyama et al., “Clinicopathological characteristics and survival difference between gastric stump carcinoma and primary upper third gastric cancer,” Journal of Gastrointestinal Surgery, vol. 17, no. 2, pp. 313–318, 2013.
View at: Publisher Site | Google Scholar
S. Takeno, T. Hashimoto, K. Maki et al., “Gastric cancer arising from the remnant stomach after distal gastrectomy: a review,” World Journal of Gastroenterology, vol. 20, no. 38, p. 13734, 2014.
View at: Publisher Site | Google Scholar
H. Huang, W. Wang, Z. Chen et al., “Prognostic factors and survival in patients with gastric stump cancer,” World Journal of Gastroenterology, vol. 21, no. 6, pp. 1865–1871, 2015.
View at: Publisher Site | Google Scholar
M. Aizawa, N. Gotohda, S. Takahashi, M. Konishi, and T. Kinoshita, “Predictive value of baseline neutrophil/lymphocyte ratio for T4 disease in wall-penetrating gastric cancer,” World Journal of Surgery, vol. 35, no. 12, pp. 2717–2722, 2011.
View at: Publisher Site | Google Scholar
M. R. Jung, Y. K. Park, O. Jeong et al., “Elevated preoperative neutrophil to lymphocyte ratio predicts poor survival following resection in late stage gastric cancer,” Journal of Surgical Oncology, vol. 104, no. 5, pp. 504–510, 2011.
View at: Publisher Site | Google Scholar
J. T. Hsu, C. C. Wang, P. H. Le et al., “Lymphocyte-to-monocyte ratios predict gastric cancer surgical outcomes,” Journal of Surgical Research, vol. 202, no. 2, pp. 284–290, 2016.
View at: Publisher Site | Google Scholar
K. Yoon, S. Lee, T. Han et al., “Comprehensive genome- and transcriptome-wide analyses of mutations associated with microsatellite instability in Korean gastric cancers,” Genome Research, vol. 23, no. 7, pp. 1109–1117, 2013.
View at: Publisher Site | Google Scholar
T. Matsuoka and M. Yashiro, “Biomarkers of gastric cancer: Current topics and future perspective,” World Journal of Gastroenterology, vol. 24, no. 26, pp. 2818–2832, 2018.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2019 Qi-Yue Chen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1537

Downloads

950

Citations