Abstract

Objective. We aimed to compare a chemiluminescent immunoassay (CIA, QUANTA Flash) on BIO-FLASH with a multiplex flow immunoassay (MFI) on BioPlex 2200 for the detection of antibodies to Ro60, Ro52, and SS-B. Methods. The study included 241 samples, from patients suffering from systemic autoimmune diseases ( ) as well as disease controls ( ). All samples were tested for anti-Ro52, anti-Ro60, and anti-SS-B (La) antibodies on QUANTA Flash (INOVA Diagnostics, San Diego, USA) and BioPlex 2200 (Bio-Rad Laboratories Inc., Hercules, USA). Discrepant samples were tested by two independent methods: BlueDot/ANA and QUANTRIX Microarray (both D-tek, Belgium). Results. The overall qualitative agreements were 95.4% (95% confidence interval, CI 92.0–97.7%) for anti-Ro52, 98.8% (95% CI 96.4–99.7%) for anti-Ro60, and 91.7% (95% CI 87.5–94.9%) for anti-SS-B antibodies. There were 34 discrepant samples among all assays (20 anti-SS-B, 11 anti-Ro52, 3 anti-Ro60). 30/33 of retested samples (by D-tek dot blot) agreed with the QUANTA Flash results. Similar findings were obtained with QUANTRIX Microarray kit. Conclusion. QUANTA Flash and BioPlex 2200 show good qualitative agreement. The clinical performances were similar for anti-Ro52 and anti-Ro60 autoantibodies while differences were observed for anti-SS-B (La) antibodies.

1. Introduction

Autoantibodies targeting extractable nuclear antigens (ENA) are hallmarks in the diagnosis of systemic autoimmune rheumatic disease (SARD) such as systemic lupus erythematosus (SLE), Sjögren’s syndrome (SjS), systemic sclerosis (SSc), polymyositis/dermatomyositis (PM/DM), and mixed connective tissue disease (MCTD). In addition, anti-ENA antibodies can be detected in undifferentiated connective tissue disease (UCTD) [1]. The primary antigenic targets of anti-ENA antibodies are U1-ribonucleoproteins (RNP), Sm (Smith antigen) [2], Scl-70 (topoisomerase I) [3], Jo-1, Ro60 (SS-A) [4], Ro52 (TRIM21) [4], and SS-B (La) [1]. Not all of those antibodies are specific for a particular disease but are useful to help ruling in or out SARD [1]. Among the most common autoantibodies are those to Ro52, Ro60 and SS-B [1]. Historically, anti-Ro52 and anti-Ro60 antibodies combined have been detected and reported [4]. However, recent data suggested that both the cellular function of the two proteins and the disease association of anti-Ro52 and anti-Ro60 antibodies are significantly different [1, 4, 5]. In addition, about 20% of those antibodies can be missed when tested using a blend of the two antigens [4]. Besides the diagnostic value of antibodies to Ro52, Ro60, and SS-B, it has been shown that those antibody specificities can precede the clinical onset of SLE for many years [6]. In addition, antibodies to the three antigens characterize a subpopulation of SLE patients that are clinically different from other SLE patients [7]. Several assays have been developed and used for the detection of anti-ENA antibodies including ELISA, line immunoassays (LIA) [8], multiplex flow immunoassay (MFI) mostly referred to as addressable laser bead assays (ALBIA) [912] and protein arrays [13]. In recent years, the chemiluminescence technology, which has been used for clinical chemistry for more than 10 years, has been applied for autoantibody testing [14, 15]. The objective of the present study was to analyze the performance of novel chemiluminescent immunoassays (CIA, QUANTA Flash) on BIO-FLASH, a rapid-response chemiluminescent analyzer in comparison with multiplex flow immunoassay on BioPlex 2200 system for the detection of antibodies to Ro60, Ro52, and SS-B. Additionally, the clinical utility of antibody titer and multiple positivity [16] were analyzed.

2. Materials and Methods

2.1. Sera

The study included 241 samples from patients suffering from SARD ( ) as well as disease controls ( ). All samples were tested for anti-Ro52, anti-Ro60, and anti-SS-B antibodies by QUANTA Flash (INOVA Diagnostics, San Diego, USA) and BioPlex 2200 (Bio-Rad Laboratories Inc., Hercules, USA). Discrepant samples were tested by two independent methods: BlueDot/ANA and QUANTRIX Microarray (both D-tek, Belgium). The diagnoses were established as described before [17] or according to the standard disease criteria.

This study meets and is in compliance with all ethical standards in medicine, and informed consent was obtained from all patients according to the Declaration of Helsinki.

2.2. QUANTA Flash Assays

The QUANTA Flash assays (INOVA Diagnostics Inc., San Diego, CA, USA) are novel CIAs that are used on the BIO-FLASH instrument (Biokit S.A., Barcelona, Spain), fitted with a luminometer, as well as all the hardware and liquid handling accessories necessary to fully automate the assay. The principle of the BIO-FLASH system has recently been described [14, 15]. The QUANTA Flash assays for this study were developed using recombinant antigens (INOVA Diagnostics, see Table 1) coated onto paramagnetic beads. Prior to use, the lyophilized beads are resuspended using the resuspension buffer. A patient serum sample is prediluted with the BIO-FLASH sample buffer in a small disposable plastic cuvette. Small amounts of the diluted patient serum, the beads, and the assay buffer are all combined into a second cuvette, mixed, and then incubated for 9.5 minutes at 37°C. The magnetized beads are sedimented using a strong magnet in the washing station and washed several times followed by addition of isoluminol conjugated anti-human IgG and again incubated 9.5 minutes at 37°C. The magnetized beads are sedimented and washed repeatedly. The isoluminol conjugate is oxidized when sodium hydroxide solution and peroxide solutions (“Triggers”) are added to the cuvette, and the flash of light produced from this reaction is measured as Relative Light Units (RLUs) by the BIO-FLASH optical system. The RLUs are proportional to the amount of isoluminol conjugate that is bound to the human IgG, which is in turn proportional to the amount of autoantibodies bound to the antigen on the beads.

2.3. BioPlex 2200

BioPlex 2200 (Bio-Rad, Hercules, CA) system is an automated analyzer that uses multiplex bead technology (Luminex, Austin, TX, US) to simultaneously detect antibodies to several antigens in a single tube. The BioPlex 2200 ANA Screen is intended for the qualitative screening of ANA, the quantitative detection of antibody to dsDNA, and the semiquantitative detection of ten separate antibodies (Chromatin, Ribosomal P, SS-A, SS-B, Sm, SmRNP, RNP, Scl-70, Jo-1, and Centromere B) [10, 11] in human serum and/or EDTA or heparinized plasma. The test system is used as an aid in the diagnosis of SARD. The system reports anti-Ro52 and anti-Ro60 antibodies as individual results outside the United States and the combined result as anti-SS-A in the United States due to lack of 510 K clearance by the Food and Drug Administration (FDA) of the anti-Ro52 antibody assay. Characteristics of the assay are summarized in Table 1.

2.4. QUANTRIX and Dot Blot

ANA12 IgG BlueDot (ANA12D+DFS70) and ANA PROFILE 25 Ag DOT (Code: AD ANA25DBD) for BlueDiver Instrument (both D-tek, Belgium) were used as comparator methods on discrepant samples. ANA12 IgG BlueDot contains the antigens: Nucleosome, Sm, RNP (68 kD/A/C), Ro60, Ro52, SSB(La), Jo-1, Scl-70, CENP-A/B, PCNA, Ribosome P(P0), and DFS70. For this study, only anti-Ro60, anti-Ro52, and anti-SS-B antibodies were used. The test procedure followed the instruction for use (see http://www.d-tek.be/). ANA PROFILE 25 Ag DOT contains the antigens: Nucleosome, dsDNA, Histones, Sm, RNP, Sm/RNP, Ro60, Ro52, SSB(La), Scl-70, Ku, PM/Scl-100, Mi-2, Jo-1, PL-7, PL-12, SRP, Ribosome P(P0), CENP-A/B, PCNA, sp100, gp210, M2 recombinant, M2/nPDC, and f-actin. For this study, only Ro60, Ro52, and SS-B were used.

2.5. Statistical Analyses

The data were statistically evaluated using the Analyse-it software (Version 1.62; Analyse-it Software, Ltd., Leeds, UK). Chi-square, Spearman’s correlation, and Cohen’s kappa agreement test were carried out to analyze the agreement between portions, and values < 0.05 were considered significant. Receiver operating characteristics (ROC) analysis was used to analyze the discriminatory ability of different immunoassays. Cluster analysis was used to illustrate the relationship between different assays [18] and to display the reactivity pattern of the patients. Hierarchical clustering was performed using average linkage clustering where patient correlation was performed uncentered and the reactivities uncentered.

3. Results

3.1. Correlation between QUANTA Flash and BioPlex 2200

The overall qualitative agreements between QUANTA Flash and BioPlex 2200 were 95.4% (95% confidence interval, CI 92.0–97.7%) for anti-Ro52, 98.8% (95% CI 96.4–99.7%) for anti-Ro60, and 91.7% (95% CI 87.5–94.9%) for anti-SS-B antibodies (Table 2). Using ROC analyses with the BioPlex 2200 results as the comparator, excellent agreement was found for anti-Ro60, good for anti-Ro52, and moderate for anti-SS-B antibodies. Areas under the curve (AUC) values were 0.99 for anti-Ro60, 1.00 for anti-Ro52, and 0.88 for anti-SS-B antibodies (see Figure 1). Additionally good quantitative agreements were observed. The Spearman rho values were: 0.95 (95% 0.94–0.96) for anti-Ro60, 0.75 (95% 0.69–0.80) for anti-Ro52, and 0.72 (95% 0.65–0.78) for anti-SS-B antibodies.

3.2. Clinical Performance of QUANTA Flash and BioPlex 2200

The prevalence and titers of anti-Ro52, anti-Ro60, and anti-SS-B antibodies in different cohorts using both assay methods can be found in Figure 2. Comparative ROC analyses were performed on all assays for patients with SARD compared with controls and showed similar results for QUANTA Flash and BioPlex 2200 for anti-Ro60 antibodies (see Figure 3). For anti-Ro52 antibodies the AUC value was significantly higher for QUANTA Flash compared to BioPlex 2200 (0.82 versus 0.69; ). However, the difference was found in the nonclinically relevant area of the AUC. For anti-SS-B antibodies the AUC value was slightly higher for QUANTA Flash compared to BioPlex 2200 (0.73 versus 0.69; ). The sensitivities and specificities among SARD, SLE, and SjS patients are shown in Table 1.

3.3. Analysis of Discrepant Samples

Discrepant samples (20 anti-SS-B, 11 anti-Ro52, 3 anti-Ro60) with sufficient residual volume ( ) were tested by two comparative methods. Thirty out of 33 discrepant samples among all assays (19 anti-SS-B, 11 anti-Ro52, 3 anti-Ro60) retested by D-tek dot blot agreed with the QUANTA Flash results (Table 3). Five of the 20 anti-SS-B discrepant samples were high positive on BioPlex (>8.0 units, above the AMR) and negative on QUANTA Flash, BlueDot, and QUANTRIX. Of the 17 BioPlex anti-SS-B positive/QUANTA Flash anti-SS-B negative samples 14 were from SARD and 4 from non-SARD patients (3 RA and one HI). All three QUANTA Flash anti-SS-B positive/BioPlex anti-SS-B negative samples were from SARD patients. All three were additionally anti-Ro60 antibody positive by both methods (QUANTA Flash and BioPlex). Figure 4 depicts a cluster analysis of all methods sorted by disease group, which serves as a visual aid of the antibody prevalence and differences between methods.

3.4. Effect of Multiple Positivity and Titer on Likelihood of Disease

To analyze the clinical utility of autoantibody titer and multiple positivity as previously described [16], we analyzed (a) the performance characteristics at the cut-off corresponding to the highest LR+ in comparison with the recommended cut-off and (b) multiple positivity (Table 4). Double positivity provided the highest LR+ for SARD compared to the controls (both for BIO-FLASH and BioPlex 2200). Highest LR+ (12.31/16.3) was obtained with SS-B at a low cut-off of 6.3 CU (QUANTA Flash)/4.3 units (BioPlex).

4. Discussion

The detection of anti-ENA antibodies is important to help in the diagnosis of SARD [1]. In recent years, several new and automated methods for the detection of anti-ENA antibodies have been developed [10, 11, 14, 15]. However, the standardization of antibody assays is still not nearly accomplished, and significant variations between different assays have been reported [19]. Since reliable detection of autoantibodies is of high importance, careful verification and validation of the assay performance is mandatory. Since the prevalence of antibodies to the other antigens contained in the BioPlex 2200 ANA profile was low and did not allow for statistical evaluation, we focused on the comparison between QUANTA Flash and BioPlex 2200 assays for the detection of anti-Ro52, anti-Ro60, and anti-SS-B antibodies.

A broad range of line immunoassays (LIA) and dot-blot assays are available and are usually used to confirm previous identified autoantibodies [20, 21]. Mainly manually performed, these assays offer a simple way of multiplex testing and even automated LIAs have become available [8]. Therefore, we choose a Dot blot assay (variation of LIA) and a microarray as confirmation assays for the discrepant samples. Multiplex assays based on the Luminex technology use addressable laser beads and are therefore often referred to as ALBIA (addressable laser bead assays) or multiplex flow immunoassay (MFI) [9]. Today several commercial MFI kits are available for the detection of autoantibodies to nuclear antigens [10, 11, 22, 23]. Similar to LIAs, the number of antigens and the antigen composition significantly varies. First generation MFI showed polyreactivity which was caused by unspecific binding to the beads. Second generation showed significant reduced polyreactivity and thus higher specificity [24]. Multiplex assays are commonly used as a screening test for ANA or other autoantibodies. Additional methods have been developed for automated ANA detection [2527]. Several publications have described protein arrays for the detection of autoantibodies to nuclear antigens [13]. However, until today those assays are not widely used in routine laboratories. The microarray used in this study showed good agreement with other methods and might represent a promising multiplex platform for autoantibody detection.

Although the QUANTA Flash and BioPlex 2200 use different sources of antigens (recombinant versus native for Ro60), the results are very similar. During the last decade, significant improvements have been made in recombinant protein technology [28]. In particular, novel strategies for the generation of recombinant Ro60 led to the availability of this antigen as a high quality recombinant protein [4]. Recombinant antigen manufacturing is more consistent and less dependent on the biological variations of the source material [28]. Therefore, the novel CIA shows similar assay performance combined with high degree of precision and consistency [15]. Despite the fact that both systems use recombinant Ro52 antigen, differences in the results were observed. Therefore, the difference might be related to the different antigen immobilization (bead chemistry) between the QUANTA Flash and the BioPlex 2200 system. However, our total percent agreement (95.4%, Table 2) is significantly better than agreements previously reported [5]. One putative reason for the significant difference between the QUANTA Flash and BioPlex 2200 results for anti-SS-B antibodies is the antigen source. The QUANTA Flash SS-B assay utilizes recombinant SS-B expressed in insect cells, whereas the BioPlex 2200 is based on native SS-B antigen [15]. Retesting of the discrepant samples using two additional methods mostly confirmed the QUANTA Flash results.

It is also important to point out that 5/17 BioPlex 2200 anti-SS-B positive samples (range 1–1.2 units) and 2/3 anti-SS-B positive samples by QUANTA Flash (range 20–25 CU) were low positive. Therefore, it is possible that a modified cut-off value would increase the agreement between BioPlex 2200 and QUANTA Flash SS-B. In the case of anti-SS-B discrepant samples, 16/20 are from SARD and 4 from “non-SARD” patients (3 RA and 1 HI). It is relevant that 3/4 “non-SARD” but only 3/16 of the SARD patients are only anti-SS-B positive. Since anti-SS-B antibodies occur in different SARD and no “gold standard” is available for the detection of anti-SS-B antibodies, it remains speculative which results are clinically correct and meaningful.

When compared to previous studies which analyzed the performance of the BioPlex 2200 system [10, 11], our data were in general agreement with the published data. In a large study on 510 healthy individuals, 0.2% (anti-Ro52), 0.6% (anti-Ro60), and 0.8% (anti-SS-B) were positive [10]. Despite the small number of HI used in our study, our data confirmed the specificity against HI. In a second study, the prevalence of antibodies to Ro52, Ro60, and SS-B was described [16]. Overall, the results were in agreement or not significant due to small patient groups. The QUANTA Flash assays have just been launched, and therefore only one paper has been published [16].

Historically autoantibody test results were mostly considered individually. Recently, several studies reported increased utility by combining autoantibody assay results and by considering antibody titers [16]. Consequently, we strived to analyze the synergy effect of combining the results of antibody testing for anti-Ro52, anti-Ro60, and anti-SS-B antibodies. Additionally, we analyze the impact of the antibody titers on the likelihood of disease. Although we found increased performance characteristics when combining results and with optimized cut-off values, the incremental value was not as pronounced as previously reported [16]. This might be explained by the strong overlap between the three antibodies we studied.

5. Conclusion

QUANTA Flash and BioPlex 2200 show good qualitative agreement. The clinical performances were similar for anti-Ro52 and Ro60 autoantibodies while differences were observed for anti-SSB (La) antibodies.

Highlights

(i)Good agreements between QUANTA Flash and BioPlex 2200 were found for anti-Ro52 and anti-Ro60.(ii)Retesting of discrepant samples confirm in the majority of cases the QUANTA Flash results.(iii)Antibody titer and multiple positivity might provide additional value for anti-ENA testing.

Abbreviations

AT:Atopic dermatitis
ALBIA:Addressable laser bead assays
AMR:Analytical measuring range
CIA:Chemiluminescent immunoassay
CLSI:Clinical and laboratory standards institute
CTD:Connective tissue disease
LIA:Line immunoassays
MFI:Multiplex flow immunoassay
PM/DM:Polymyositis/dermatomyositis
RA:Rheumatoid arthritis
ROC:Receiver-operating characteristics
SARD:Systemic autoimmune rheumatic disease
SED:Suspected eye disease
SLE:Systemic lupus erythematosus
SjS:Sjögren’s syndrome
SSc:Systemic sclerosis
UCTD:Undifferentiated connective tissue disease.

Conflict of Interests

M. Mahler, C. Bentow, and A. Seaman are employed at INOVA diagnostics selling autoantibody assays. M. Manfredi and M. Infantino receive congress sponsor from INOVA and BIORAD. The other authors have no conflict of interests.