Abstract

Quite a few studies have revealed the clinical values regarding the outcome predictions in the cohort of the Synergy between Percutaneous Coronary Intervention with Taxus and Cardiac Surgery (SYNTAX) trial and decision-making with the SYNTAX score. The Evaluation of Xience Everolimus-Eluting Stent Versus Coronary Artery Bypass Surgery for Effectiveness of Left-Main Revascularization (EXCEL) and Nordic-Baltic-British left main revascularization (NOBLE) studies are the largest international randomized studies so far, comparing percutaneous coronary intervention (PCI) and coronary artery bypass graft (CABG) in the treatment of left main coronary artery disease. Unfortunately, both studies failed to validate the value of the SYNTAX score in the selection of revascularization strategies for patients with coronary artery diseases (CAD).. This scenario prompted us to reconsider the inherent fallacies of the SYNTAX score in its derivation. We pointed out eight fallacies for the SYNTAX score in this paper. A recently developed Coronary Artery Tree description and Lesion EvaluaTion (CatLet) score, available at http://www.catletscore.com, a novel angiographic scoring system, could be the remedies for the SYNTAX score.

1. Introduction

The Synergy between Percutaneous Coronary Intervention with Taxus and Cardiac Surgery (SYNTAX) score is an angiographic tool to grade the complexity and severity of coronary artery disease (CAD) [1]. Quite a few studies have revealed the clinical values regarding the outcome predictions in the cohort of the SYNTAX trial and the decision-making with the SYNTAX score [24]. The guideline gives a class I or IIa indication for percutaneous coronary intervention (PCI) in patients with significant left main disease and low or intermediate SYNTAX score [5]. The Evaluation of Xience Everolimus-Eluting Stent Versus Coronary Artery Bypass Surgery for Effectiveness of Left-Main Revascularization (EXCEL) and Nordic-Baltic-British left main revascularization (NOBLE) studies are the largest international randomized studies so far, comparing PCI and coronary artery bypass graft (CABG) in the treatment of left main coronary artery disease [6, 7]. Unfortunately, both studies failed to validate the value of the SYNTAX score in the selection of revascularization strategies for CAD patients. In the NOBEL trial, a substantially better outcome was still observed in the low SYNTAX score group undergoing CABG; In the EXCEL trial, 4-year mortality was comparable between PCI and CABG in both low (≤22) and intermediate [817] anatomical SYNTAX scores ((0.69 (95% prediction interval (PI): 0.34–1.45) vs. 0.93 (95% PI: 0.53–1.62)), without significant differences, in contrast with the SYNTAX trial [6, 7, 18, 19]. These studies challenged the original intention of the SYNTAX score at least in part, selecting optimal strategies for PCI or CABG [7, 20, 21]. In the PCI arm in the NOBEL trial, the SYNTAX score also failed to predict adverse outcomes, different from the SYNTAX trial [18, 19]. These conflicting results regarding the value of the outcome prediction with the SYNTAX score reminded us of its inherent fallacies in the derivation.

2. Oversimplified Dichotomization of the Coronary Circulation Pattern into Right or Left Dominance

In the general population, the right coronary artery (RCA) supplying blood to the territory of the left ventricle (LV) should be a continuous spectrum with two extremes at either side: the RCA does not supply blood to the LV with a resulting dominant left circumflex (LCX) or the RCA supplies blood to most portion of the LV with a resulting small LCX. Thus, any attempt to simply dichotomize the RCA size is not wise and will obviously deviate from the clinical practice. Figures 1(a)1(f) present progressive changes in RCA sizes. According to the SYNTAX score, Figures 1(b)1(f) are all defined as right dominant, and their weightings are invariably 1.0. As a matter of fact, it is difficult to understand that the RCA in Figure 1(b) contributes equally as in Figure 1(f) in terms of blood supply to the LV. It is also not surprising that it is difficult to find vessels to be appropriately named as 16a, 16b, or 16c in the SYNTAX score calculation.

3. Mixed-Up Values from the Stenosis Lesion and Its Adverse Characteristics

The SYNTAX score encompasses two components: one is from the stenosis lesion and the other is from its adverse characteristics, such as bifurcation, trifurcation, angulation, thrombus, and calcification. For the stenosis lesion, the score is the product of a weighting factor of a diseased vessel and its stenosis degree; for those adverse characteristics, the score values are directly assigned. It is obviously inappropriate to mix up these two scores of different origins with different implications, which are required to be investigated separately.

4. Violation of the Law of Flow Conservation in the Weighting Assignment

According to the law of flow conservation [22], a parent vessel equals the sum of its daughter vessels in terms of blood flow. In the right dominance, the RCA gives rise to the posterior descending artery (PDA) and posterolateral vessels (PLVs); therefore, the proximal, mid, or distal RCA should equal the sum of the PDA and PLVs in terms of blood flow. Correspondingly, the weighting factor of the proximal, mid, or distal RCA should equal the sum of the PDA and PLVs. Unfortunately, in the SYNTAX score, the weighting of the proximal, mid, or distal RCA is 1.0, the weighting of the PDA, a branch from the RCA, is surprisingly 1.0, and the weighting of PLVs, also branches from the RCA, is surprisingly 1.5 (0.5 + 0.5 + 0.5), violating the law of flow conservation and leading to logic errors as shown in Table 1 [1].

5. The Nomenclature-Based Weighting Assignment of the Coronary Tree Segments

In the SYNTAX score, the weighting assignment to the coronary tree segments remains to be essentially nomenclature-based although their importance has been partly considered. The intermediate branch has been invariably assigned 1.0 in right-dominant circulation in the SYNTAX score. In most circumstances, however, patients had intermediate branches of different sizes, and this invariable assignment of 1.0 failed in reflecting the variability in the intermediate branches.

6. Arbitrary Value Assignment for Those Adverse Characteristics

Unfortunately, we, as of today, have failed to find the evidence based on which the score values are assigned for those adverse characteristics [1]. Value assignments for adverse characteristics are arbitrary in the SYNTAX score. Actually, most adverse characteristics except the calcification have not predicted clinical outcomes for CAD patients [2328]. Therefore, independent studies are required to identify different contributions to outcome predictions for individual adverse characteristics before we assign values to those adverse characteristics.

7. Lower Reproducibility of the SYNTAX Score

For ordered variables, the weighted kappa values were used to express the degree of agreement: slight, kappa values ranging 0.0∼0.2; fair, ranging 0.2∼0.4; moderate, ranging 0.4∼0.6; substantial, ranging 0.6∼0.8; almost perfect, ranging 0.8∼1.0 [29]. The SYNTAX trial investigators first reported a weighted kappa value of 0.45 for interobserver reproducibility on the global SYNTAX score and a weighted kappa value of 0.59 for intraobserver reproducibility [30]. Another independent study from the SYNTAX trial investigators also reported a moderate degree of agreement with a kappa value of 0.51 for intraobserver reproducibility according to the tertile analysis (<23, 23∼33, ≥33) on the global SYNTAX score [31]. Two studies from the non-SYNTAX trial team independently assessed the reproducibility of the SYNTAX score and found that the weighted kappa values were less than 0.60 for interobserver variability according to the tertile analysis (<23, 23∼33, ≥33), while the weighted kappa values for intraobserver variability were around 0.70. The interobserver agreement of on-site interventional cardiologists was initially at best fair (kappa = 0.33 [0.18, 0.44]) after basic training, improving to substantial or greater after advanced training (kappa = 0.76 [0.64, 1.00]). Despite advanced training, the on-site interventional cardiologists still underscored the number of lesions, bifurcations, and small-vessel disease, which resulted in a lower reproducibility than the core lab technicians [32].

8. SYNTAX  Score II Is Not a True Remedy for the Anatomical SYNTAX Score

SYNTAX score II performed better than the anatomical SYNTAX score in 4-year mortality predictions, demonstrating that the seven more predictors (age, creatinine clearance, left ventricular ejection fraction (LVEF), presence of unprotected left main coronary artery (ULMCA) disease, peripheral vascular disease, female sex, and chronic obstructive pulmonary disease (COPD)) had predicting values and that the anatomical SYNTAX score left much room to be improved [8]. Only 35% of the intermediate (50–70%) angiographic stenosis were hemodynamically relevant as defined by the fractional flow reserve (FFR) ≤0.80 [9]. In the ERACI (Estudio Randomizado Argentino Angioplastia versus Cirugia) risk score, modifying the basal and residual SYNTAX score calculation, the intermediate lesions (50∼69%), small vessels (1.5∼2.0 mm in diameter), and some adverse characteristics, such as bifurcation, trifurcation, and chronic total occlusion, were excluded from being scored. This simple exclusion yielded similar results as compared with the fractional flow reserve-guided revascularization [1012]. The FFR-guided evaluation of lesions will help in the SYNTAX score calculation. It is unimaginable that the anatomical SYNTAX score needing seven more predictors to fix up is a good tool in clinical practice and that the seven predictors sufficed to construct a new model to replace the anatomical SYNTAX score. Actually, the parsimonious model, ACEF (age, creatinine, and LVEF), predicted clinical outcomes well, with reported concordance indices of 0.63∼0.81, similar to or better than the anatomical SYNTAX score [1315]. Therefore, any remedies not remedying the anatomical SYNTAX score per se should not be considered as true remedies.

9. The Need for Adapting Modification

Within one segment, direct scoring will overestimate the severity of coronary artery disease in the presence of side branches preceding the main branch lesion regardless of their normal or diseased status. In Figure 2, the proximal LAD had an occlusive lesion and a significant diagonal. According to the SYNTAX score, this occlusive lesion will be directly scored as 3.5 × 5 = 17.5, which obviously overestimates the severity of the LAD because of the presence of the significant diagonal. Therefore, this occlusive lesion on the proximal LAD should be reasonably modified for 3.5 × 5 − 1.0 × 5 = 12.5.

10. Remedies for the SYNTAX Score

The Coronary Artery Tree description and Lesion EvaluaTion (CatLet) score, accommodating the variability in the coronary anatomy, has been a recently developed comprehensive angiographic scoring system aimed at assisting in the risk stratification of CAD patients and in the standardization of the angiographic data collection [16]. In the CatLet score, the lesion and the adverse angiographic characteristics are defined as in the SYNTAX score. The CatLet score had four characteristics: (1) the coronary circulation pattern is overall evaluated first before we proceed; (2) only a lesion ≥50% diameter stenosis in vessels >1.5 mm in diameter is scored and modified if appropriate; (3) the eight adverse angiographic characteristics pertinent to the lesion are not scored any more, but only qualitatively recorded instead; and (4) the diffuse disease/small vessels are given up to be evaluated, quantitatively or qualitatively. Most reproducibility studies did not report the kappa values regarding the diffuse disease/small vessels in the SYNTAX score [17, 30, 31, 33]; two studies reported that the kappa values regarding the diffuse disease/small vessels were less than 0.4, at best a fair degree of agreement even after advanced training [32], highlighting the difficulty in evaluating the diffuse disease/small vessels defined in the SYNTAX score. That is the reason why we give up to evaluate this angiographic characteristic. Regarding the eight adverse angiographic characteristics, their individual contributions to the outcome prediction need to be investigated separately from the lesion score. The calculator of the CatLet score and its elaborate tutorial are available at http://www.catletscore.com. The IE browser or Microsoft Edge is required to run this calculator. Table 2 lists the differences and similarities with respect to criteria and definitions between the SYNTAX score and the CatLet score.

This novel CatLet angiographic scoring system has been described in full, following the following classifications and rules: the 17-myocardial segment model, the law of flow conservation, and the law of competitive blood supply [22, 34]. In the 17-myocardial segment model, the LV is approximately evenly divided into 17 segments. Each segment can be taken as 1 mass unit or 1 actual flow unit given that the actual myocardial blood flow is proportional to the muscle mass. The importance of a blood vessel depends on how many segments the blood vessel supplies rather than on the nomenclature of the blood vessel. Therefore, if the LAD supplies 7 segments, its weighting factor will be assigned 7.0. The weighting assignment to LCX and RCA follows the same rule. According to our new reclassification scheme, the RCA is progressively divided into 6 types: PDA zero, PDA only, small RCA, average RCA, large RCA, and super RCA; the LAD is progressively divided into 3 types: short, average, and long; and the Dx is progressively divided into 3 types: small, intermediate, and large, which together result in 54 types of the coronary circulation pattern [16]. A total of 54 types of the coronary circulation pattern are utilized to cover the variability of the coronary anatomy among individuals. The coursing and supplying territory are relatively easy to be identified for LAD, PDA, and Dx, but not for LCX on the angiograms. LCX is indirectly reflected by RCA, LAD, and Dx according to the law of competitive blood supply. Therefore, the first step to overall evaluate the coronary circulation pattern is achieved by the evaluation of LAD, PDA, and Dx, but not including LCX.

Our first validation study revealed that the CatLet score better predicted the clinical outcomes for acute myocardial infarction patients than the SYNTAX score [35]. Compared with the SYNTAX score, the CatLet score had a better discrimination and calibration for outcome prediction, which resulted in a better refined and balanced risk stratification with the CatLet score according to its tertile analysis (≤9, 10–14, and >15). Specifically, 6.2% of patients with MACCE and 6.6% of patients without MACCE were correctly reclassified from the SYNTAX tertiles into the CatLet score tertiles, respectively. Consequently, the category-free net reclassification improvement (NRI) was 37.2% (z = 2.65, ). NRIs for 4.3-year cardiac death and all-cause death were 35.5% and 31.8% , respectively [35]. We also reported a satisfactory kappa value greater than 0.8, almost an excellent degree of agreement beyond the level of chance with the CatLet score [36].

Given that the CatLet score is derived based on the acknowledged classifications and rules, and its utility has been preliminarily validated in patients with acute myocardial infarction undergoing primary PCI. Therefore, the CatLet angiographic scoring system proposed recently may be the remedies for the SYNTAX score although we have to admit that the value of this novel angiographic scoring system warrants further validation in different CAD populations, such as left main disease and chronic total occlusion.

Data Availability

The data used to support the findings of this study are available at http://www.chictr.org.cn (unique identifiers: ChiCTR-POC-17013536).

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

Yong-Ming He and Li Shen contributed equally to this work.

Acknowledgments

This work was in part supported by National Key R&D Program (2020YFC2004705) and the Sci-Tech Development Program of Suzhou City (SYS2019040).