Abstract

Introduction. The objective of the present study was to compare QUANTA Flash dsDNA, a chemiluminescent immunoassay (CIA) on the BIO-FLASH, a rapid-response chemiluminescent analyzer, to three other anti-dsDNA antibody assays and to Crithidia luciliae indirect immunofluorescence test (CLIFT). Methods. In the first part of the study, 161 samples, 61 from patients suffering from systemic lupus erythematosus (SLE) and 100 from a disease control group, were tested by QUANTA Flash dsDNA CIA, QUANTA Lite dsDNA SC ELISA, BioPlex 2200 multiplex flow immunoassay (MFI), ImmuLisa dsDNA ELISA, and NOVA Lite CLIFT. A second cohort of 69 SLE patients was then tested by QUANTA Flash dsDNA and CLIFT to expand the study. Results. The overall qualitative agreements varied between 77.0% (NOVA Lite CLIFT versus QUANTA Lite) and 89.4% (ImmuLisa versus NOVA Lite CLIFT). The clinical sensitivities for the anti-dsDNA antibody tests varied from 8.2% (NOVA Lite CLIFT) to 54.1% (QUANTA Lite), while the clinical specificities varied from 88.0% (BioPlex 2200) to 100.0% (NOVA Lite CLIFT). Good correlation was found between QUANTA Flash dsDNA and NOVA Lite CLIFT. Conclusion. Significant variations among dsDNA methods were observed. QUANTA Flash dsDNA provides a good combination of sensitivity and specificity for the diagnosis of SLE and good agreement to CLIFT.

1. Introduction

The detection of anti-dsDNA autoantibodies represents a hallmark in the diagnosis of systemic lupus erythematosus (SLE) [1] and these antibodies are part of the classification criteria for SLE [2, 3]. Additionally, anti-dsDNA antibodies measured by certain assays have been reported to correlate with disease activity and lupus nephritis. Despite the fact that several assay systems have been developed during the last decades, controversies persist on which assay is the best test to measure anti-dsDNA antibodies [4, 5]. Although the Farr assay has been considered the “gold standard” for the detection of anti-dsDNA antibodies in many laboratories [4, 6, 7], radioimmunoassays in general have recently been falling into disuse in routine practice based on several factors, including the radioactive nature of the assay. Therefore, it is important to evaluate new fully automated technologies which have recently become available as viable alternatives to Farr assay. The objective of the present study was to compare QUANTA Flash dsDNA, a chemiluminescent immunoassay (CIA) on the BIO-FLASH, a rapid-response chemiluminescent analyzer, to three other anti-dsDNA antibody assays and to Crithidia luciliae indirect immunofluorescence test (CLIFT).

2. Materials and Methods

2.1. Sera

In the first part of the study, 161 samples, 61 from patients suffering from SLE and 100 controls, including Hashimoto’s thyroiditis (), rheumatoid arthritis (), and blood donors () from apparently healthy individuals, were tested for anti-dsDNA IgG by QUANTA Flash dsDNA CIA (Inova Diagnostics, San Diego, CA, USA), QUANTA Lite dsDNA SC ELISA (Inova Diagnostics Inc.), BioPlex 2200 MFI (Bio-Rad, USA), ImmuLisa dsDNA ELISA (Immco Diagnostics, Buffalo, NY, USA), and NOVA Lite CLIFT (Inova Diagnostics). A second cohort of 69 SLE patients was tested by QUANTA Flash dsDNA CIA and NOVA Lite CLIFT to expand the first part of the study for these methods. The diagnoses were established as described in a previous paper before or, if applicable, according to the standard disease criteria [8].

This study meets and is in compliance with all ethical standards in medicine, and informed consent was obtained from all patients according to the Declaration of Helsinki.

2.2. QUANTA Flash dsDNA

The QUANTA Flash dsDNA (Inova Diagnostics Inc.) assay is a novel CIA that is used on the BIO-FLASH instrument (Biokit s.a., Barcelona, Spain), fitted with a luminometer, as well as the hardware and liquid handling accessories necessary to fully automate the assay. The principle of the BIO-FLASH system has recently been described [9, 10]. The QUANTA Flash assay for this study was developed using synthetic dsDNA (see Table 1) coupled to the surface of paramagnetic beads. Prior to use, the lyophilized beads are resuspended using the resuspension buffer. A patient serum sample is prediluted with the BIO-FLASH sample buffer in a small disposable plastic cuvette. Small amounts of the diluted patient serum, the beads, and the assay buffer are all combined into a second cuvette, mixed, and then incubated for 9.5 minutes at 37°C. The magnetized beads are sedimented using a strong magnet in the washing station and washed several times followed by addition of isoluminol conjugated anti-human IgG and again incubated for 9.5 minutes at 37°C. The magnetized beads are sedimented and washed repeatedly. The isoluminol conjugate is oxidized when sodium hydroxide solution and peroxide solutions (triggers) are added to the cuvette, and the flash of light produced from this reaction is measured as relative light units (RLUs) by the BIO-FLASH optical system. The RLUs are proportional to the amount of isoluminol conjugate that is bound to the human IgG, which is in turn proportional to the amount of autoantibodies bound to the antigen on the beads.

2.3. BioPlex 2200

BioPlex 2200 (Bio-Rad, Hercules, CA) system is an automated analyzer that uses multiplex bead technology (Luminex, Austin, TX, USA) to simultaneously detect antibodies to several antigens in a single tube. The BioPlex 2200 ANA Screen is intended for the qualitative screening of ANA, the quantitative detection of antibody to dsDNA, and the semiquantitative detection of ten separate antibodies (Chromatin, Ribosomal P, SS-A, SS-B, Sm, SmRNP, RNP, Scl-70, Jo-1, and Centromere B) [11, 12] in human serum and/or EDTA or heparinized plasma. The test system is used as an aid in the diagnosis of SARD. Characteristics of the assay are summarized in Table 1.

2.4. ELISAs (ImmuLisa dsDNA ELISA and QUANTA Lite dsDNA SC ELISA)

Both the ImmuLisa dsDNA (Immco Diagnostics) and QUANTA Lite dsDNA SC (Inova Diagnostics Inc.) are enzyme linked immunosorbent assays (ELISA) for the quantitative or semiquantitative detection of IgG specific for dsDNA in human serum as an aid in the diagnosis of SLE in conjunction with other laboratory and clinical findings. Both assays were performed at Inova Diagnostics according to the direction insert. Characteristics of the assays are summarized in Table 1.

2.5. NOVA Lite dsDNA Crithidia luciliae (CLIFT)

NOVA Lite dsDNA CLIFT (Inova Diagnostics Inc.) is an indirect immunofluorescence (IIF) assay for the screening and titration based determination of anti-dsDNA antibodies in human serum. The NOVA Lite dsDNA CLIFT employs the hemoflagellate Crithidia luciliae as a substrate. This single-cell organism possesses a giant mitochondrion containing a highly condensed mass of circular dsDNA. The assay was performed by a single operator using an LED microscope at Inova Diagnostics according to the direction insert. CLIFT results were graded from 0 to 4 according to the intensity (see also direction insert of the kit); 4 is brilliant apple green fluorescence; 3 is bright apple green fluorescence; 2 is clearly distinguishable positive fluorescence; 1 is lowest specific fluorescence that enables the kinetoplast staining to be clearly differentiated from the background fluorescence; 0 is negative. Characteristics of the assay are summarized in Table 1.

2.6. Precision and Linearity Studies

Precision and linearity of the QUANTA Flash dsDNA CIA were verified by performing the required testing according to the Clinical and Laboratory Standards Institute (CLSI) guidelines. For the precision study, the within-run, between-day, between-run, and total precision were determined by running two aliquots of the precision samples twice a day in random order, with a minimum of 2 hours between each run. The samples were run on the same instrument for each assay and repeated for at least 20 days, according to CLSI guideline EP5-A2. Linearity testing was performed according to CLSI guideline EP6-A (volume 23, number 16), which involved diluting several high titer sera in a serial dilution scheme to span the analytical measuring range (AMR) for each assay.

2.7. Statistical Analyses

The data were statistically evaluated using the Analyse-it software (version 1.62; Analyse-it Software, Ltd., Leeds, UK). Spearman’s correlation and Cohen’s kappa agreement test were carried out to analyze the agreement between portions and values < 0.05 were considered significant. Receiver operating characteristics (ROC) analysis was used to analyze the discriminatory ability of different immunoassays. Cluster analysis was used to illustrate the relationship between different assays [13] and to display the reactivity pattern of the patients. Hierarchical clustering was performed using average linkage clustering where patient correlation was performed uncentered and the reactivities were uncentered. For the assays having an equivocal range, all data was analyzed using the applied cut-offs listed in Table 1, where the equivocal results were considered positive.

3. Results

3.1. Precision and Linearity

For the precision testing of QUANTA Flash dsDNA CIA, seven samples ranging from 27.3 to 402.8 IU/mL were tested. For all samples, the within-run varied between 4.7 and 6.9%, the between-day varied between 2.3 and 4.0%, and the between-run varied between 0.0 and 4.9%. The total precision for the assay varied between 6.6 and 8.2%. The linearity study showed linearity of the QUANTA Flash dsDNA CIA from 7.8 to 683.8 IU/mL with a slope of 1.06 (95% confidence interval 1.04–1.08), a -intercept of −2.0 (−6.9–2.8), and an of 0.99. QUANTA Flash dsDNA CIA demonstrated linearity over the entire AMR.

3.2. Qualitative and Quantitative Agreements between dsDNA Methods

The overall qualitative agreements varied between 77.0% (NOVA Lite CLIFT versus QUANTA Lite) and 89.4% (ImmuLisa versus NOVA Lite CLIFT). Kappa agreements were low ranging from 0.17 to 0.42 (QUANTA Lite and QUANTA Flash versus BioPlex). Total percent agreement, kappa values, and Spearman’s rho between dsDNA methods can be found in Table 2 (Spearman correlation graphs between dsDNA methods are not shown).

3.3. Clinical Performance of Five Anti-dsDNA Assays

The clinical sensitivities at the recommended cut-off were 8.2% (95% confidence interval, CI 2.7–18.1%) for NOVA Lite CLIFT, 26.2% (95% CI 15.8–39.1%) for ImmuLisa, 39.3% (95% CI 27.2–52.7%) for QUANTA Flash, 44.3% (95% CI 31.5–57.6%) for BioPlex, and 54.1% (95% CI 40.8–66.9) for QUANTA Lite. The clinical specificities at the recommended cut-off were 100.0% (95% CI 96.4–100.0%) for NOVA Lite CLIFT, 96.0% (95% CI 90.1–98.9%) for ImmuLisa, 96.0% (95% CI 90.1–98.9%) for QUANTA Flash, 88.0% (95% CI 80.0–93.6%) for BioPlex, and 91.0% (95% CI 83.6–95.8%) for QUANTA Lite. When the sensitivities were compared at a specificity of 94.0%, the values ranged between 8.2% (95% CI 2.7–18.1%) for CLIFT and 52.5% (95% CI 39.3–65.4%) for QUANTA Flash dsDNA CIA. Sensitivities and specificities as well as positive and negative likelihoods ratios (LR) and area under the curve (AUC) values for all assays are shown in Table 3. The odds ratio (LR+/LR−) for dsDNA methods varied between 5.9 (BioPlex) and 15.6 (QUANTA Flash). Comparative ROC curve analysis among SLE patients () and disease controls () for five anti-dsDNA antibody assays showed significantly different AUC values. QUANTA Flash and QUANTA Lite had the highest AUC values which were significantly higher () than the AUC values of the other assays (see Figure 1).

3.4. Cluster Analysis

To illustrate the reactivity of various assays in relation to the diagnosis, we performed a cluster analysis. The cluster analysis shows that the majority of SLE patients have multiple positive results (Figure 2). Some of the controls also show positive results by different methods. The dendrogram shows the QUANTA Lite dsDNA SC clusters closest to the diagnosis of SLE followed by QUANTA Flash and BioPlex 2200.

3.5. Comparison of Anti-dsDNA Assays with CLIFT and Extended Clinical Evaluation for QUANTA Flash dsDNA

The CLIFT is often used as a confirmatory assay. Consequently, we used the CLIFT results (positive versus negative) as the reference and analyzed the utility of the other assays to match the sensitivity and specificity of the CLIFT. All CLIFT positive samples were also positive by all four methods, except for one sample that was missed by the ImmuLisa. ROC analysis (ROC curve not shown) of the four anti-dsDNA antibody assays compared to CLIFT resulted in AUC values of 0.93 (95% CI 0.85–1.00) for BioPlex, 0.94 (95% CI 0.88–1.00) for ImmuLisa, 0.95 (95% CI 0.91–0.99) for QUANTA Lite, and 0.97 (95% CI 0.94–0.99) for QUANTA Flash. A cut-off of 106.7 IU/mL for QUANTA Flash dsDNA would result in an optimal agreement to CLIFT, with a positive agreement of 100.0% (95% CI 47.8–100.0%), negative agreement of 95.5% (95% CI 91.0–98.2%), total agreement of 95.7% (95% CI 91.2–98.2%), and kappa = 0.57 (95% CI 0.29–0.85). To further validate the good agreement between QUANTA Flash dsDNA and CLIFT, additional SLE patients (, Inova Diagnostics serum bank) tested by both methods were added to the study population. ROC analysis of the clinical performance for NOVA Lite CLIFT and QUANTA Flash dsDNA among the new study population (SLE = 130, controls = 100) can be found in Figure 3. ROC analysis for the agreement of QUANTA Flash dsDNA results to NOVA Lite CLIFT results can be found in Figure 4.

4. Discussion

Anti-dsDNA antibodies are a hallmark in the diagnosis of SLE and are part of the classification criteria [2]. During the last decades, several novel technologies have been developed for anti-dsDNA antibody detection including the conventional ELISA and, more recently, line immunoassays (LIA), CIA, and multiplex assays [11, 12]. As ELISAs are only moderately fast with assay times between 1.5 and 3 hours, the focus has lately shifted towards a decrease in assay time and ease of use. Despite significant technological advances, controversies persist on the method of choice for the detection of these antibodies [4, 14]. The BioPlex 2200 dsDNA assay has been compared to other assays (Farr and Farrzyme) in a recent study [15]. Additionally, several studies used the BioPlex 2200 dsDNA assay as the only method for the detection of anti-dsDNA antibodies [16, 17]. The sensitivity in our cohort (44.3%) was very similar to the data (40%) presented by Op De Beéck et al. [16] but significantly lower than previous results [18]. The CLIFT assay is an IIF test based on the hemoflagellate Crithidia luciliae as the substrate. Commercial assays are offered by various companies. Various commercial ELISA tests are available through numerous companies. Although based on the same technology, poor agreement can be observed, as seen in previous studies [14, 15, 19, 20]. Similar to the sensitivity observed for BioPlex 2200 dsDNA in this study, the sensitivity in SLE found for the two ELISAs was lower than previous studies [21, 22], indicating that the SLE sample population for this study could be the reason. Lastly, the Farr assay has been considered as the “gold standard” for the detection of anti-dsDNA antibodies [4, 6, 7]. However, not in all studies, the Farr assay was superior to other methods for the detection of anti-dsDNA antibodies and the discrimination of SLE and controls [14]. Additionally, in many countries, laboratories are switching from the Farr assay to fully automated solutions, which is largely due to the radioactive nature of the Farr assay [4, 5]. Therefore, considering that newer fully automated technologies are available, it is important to evaluate these methods as viable alternatives as the Farr assay becomes less popular. Some studies also investigated the impact of the antigen source on the performance of anti-dsDNA antibody assays. Since this study compares not only different technologies but also methods with different antigen sources, it is unclear if antigen source is a contributor to the variability in the results. This is the first study on QUANTA Flash dsDNA, a novel CIA for detection of anti-dsDNA antibodies. Like other assays on the BIO-FLASH [9, 23, 24], the QUANTA Flash dsDNA CIA delivers quantitative results with high precision and linearity in as little as 30 minutes. The QUANTA Flash dsDNA CIA showed lower sensitivity compared to the QUANTA Lite dsDNA ELISA (39.3% versus 54.1%) but had a higher specificity (96.0% versus 91.0%) and a higher odds ratio compared to the other methods. By setting the specificity to the clinically relevant level of 94.0% for all dsDNA methods, QUANTA Flash dsDNA CIA achieved the highest sensitivity (52.5%). Since the CLIFT assay is often used as a confirmatory test for the detection of anti-dsDNA antibodies, we aimed to analyze the possibility to use higher cut-off values for QUANTA Flash dsDNA to increase the agreement to CLIFT. Using a cut-off of 106.7 IU/mL, the agreement increased to 95.7%. The extended study between QUANTA Flash dsDNA CIA and NOVA Lite CLIFT with additional SLE samples resulted in good agreement between methods around the manufacturer’s cut-off for QUANTA Flash dsDNA. Figure 4 displays the agreement of QUANTA Flash dsDNA to CLIFT at various cut-offs, which demonstrates the potential to match the samples positive by CLIFT. This finding is promising that, using the QUANTA Flash dsDNA, confirmation testing might become unnecessary. However, future studies are needed to confirm this observation. A limitation of our study is the number of SLE patients and controls, but the strength of the study is the number of technologies analyzed. However, despite the small cohort of patients, we found significant differences between the assays and confirmed the lack of standardization [19, 20]. Another shortcoming is the exclusion of the Farr assay from our study due to the lack of access to the technology. At our facility, assays with radioactive materials cannot be performed and the sample volumes were too low to send out samples for testing. On the other hand, we included five methods for the detection of anti-dsDNA antibodies. Further studies with larger cohorts are needed to contribute to the understanding of how anti-dsDNA antibody assays perform and correlate.

5. Conclusion

Significant variations among anti-dsDNA antibody assays were observed confirming the lack of standardization. QUANTA Flash dsDNA CIA provides an optimal combination of sensitivity and specificity for the diagnosis of SLE. Future studies with larger sample populations are needed to confirm the clinical performance and agreement to CLIFT.

Abbreviations

AUC:Area under the curve
AMR:Analytical measuring range
CIA:Chemiluminescent immunoassay
CLIFT: Crithidia luciliae indirect immunofluorescence test
CTD:Connective tissue disease
ELISA:Enzyme-linked immunosorbent assay
LIA:Line immunoassays
MFI:Multiplex flow immunoassay
ROC:Receiver-operating characteristics
SARD: Systemic autoimmune rheumatic disease
SLE:Systemic lupus erythematosus.

Highlights

(i)Significant variations among dsDNA methods were observed.(ii)QUANTA Flash dsDNA showed good analytical and clinical performance in this study.(iii)Standardization of anti-dsDNA assays still requires improvements.

Conflict of Interests

M. Mahler, C. Bentow, and P. Martis are employed at Inova Diagnostics selling autoantibody assays. M. Manfredi, M. Infantino, and A. Rigon receive congress grants from Inova Diagnostics and Bio-Rad. The other authors have no conflict of interests.