Abstract

This study evaluates the performance of five two-step SYBR Green RT-qPCR kits and five one-step SYBR Green qRT-PCR kits using real-time PCR assays. Two real-time thermocyclers showing different throughput capacities were used. The analysed performance evaluation criteria included the generation of standard curve, reaction efficiency, analytical sensitivity, intra- and interassay repeatability as well as the costs and the practicability of kits, and thermocycling times. We found that the optimised one-step PCR assays had a higher detection sensitivity than the optimised two-step assays regardless of the machine used, while no difference was detected in reaction efficiency, R2 values, and intra- and interreproducibility between the two methods. The limit of detection at the 95% confidence level varied between 15 to 981 copies/µL and 41 to 171 for one-step kits and two-step kits, respectively. Of the ten kits tested, the most efficient kit was the Quantitect SYBR Green qRT-PCR with a limit of detection at 95% of confidence of 20 and 22 copies/µL on the thermocyclers Rotor gene Q MDx and MX3005P, respectively. The study demonstrated the pivotal influence of the thermocycler on PCR performance for the detection of rabies RNA, as well as that of the master mixes.

1. Introduction

Rabies, which is caused by all members of the genus Lyssavirus, family Rhabdoviridae, is a viral encephalitis that is found on every continent except Antarctica. The Lyssavirus genus is divided into 14 species, the majority of which are predominantly associated with infection in bats [1]. Bats are natural reservoirs for all lyssaviruses and are considered to represent the ancestral host for the lyssaviruses [2]. In Europe, bat rabies is caused by four lyssaviruses, namely, European bat Lyssavirus type 1 (EBLV-1), European bat Lyssavirus type 2 (EBLV-2), Bokeloh bat Lyssavirus (BBLV), and Lleida bat Lyssavirus (LLEBV). Between 1977 and 2013, more than 1,000 cases of bat rabies were reported [3], with the majority (>97%) being attributed to EBLV-1.

Rabies diagnosis based upon clinical presentation or gross pathognomonic lesions is unreliable, because signs of the disease are not characteristic and may vary greatly from one animal to another. Therefore, diagnosis in animals relies on postmortem laboratory findings. The WHO “gold standard” test for rabies diagnosis in animals is the fluorescent antibody test (FAT) in which FITC anti-rabies virus antibody is applied to selected regions of the brain collected postmortem [4]. Evidence of a rabies infection can be demonstrated through the detection of antigen (FAT), infectious virus (rabies tissue culture infection test (RTCIT), mouse inoculation test (MIT)), or viral RNA (nucleic acid amplification tests), these conventional OIE diagnostic tests being entirely dependent on the nature and quality of the sample supplied. With the advent of molecular biology since the 1980s and due to the immense versatility and sensitivity of PCR, diagnostic methods based on PCR technology have been extensively applied to many infectious diseases [5]. To date, real-time PCR is the state-of-the-art technology for the quantification of nucleic acids. Various nucleic acid detection-based assays have thus been published for the detection of Lyssavirus fragments using conventional gel-based PCR, NASBA, or real-time PCR [6]. In Europe, most laboratories working on rabies employ conventional and/or real-time PCR [7] due to their high specificity and sensitivity. The conventional methods are reported to be very sensitive when using a heminested RT-PCR [8] and compared to heminested RT-PCR, real-time PCR is shown to be about 100–1,000-fold more sensitive [9]. However, due to this high PCR sensitivity, which engenders a risk of sample cross contamination and therefore a risk of potential false positive results, RT-PCR is not recommended by the World Health Organization for routine postmortem diagnosis of rabies in animals [4].

Real-time RT-PCR which provides rapid, sensitive, and specific detection of rabies virus decreases the risk of sample contamination. Various real-time assays have thus been described since 2004 [10] for the rapid detection of RABV or other Lyssavirus species [11, 12] using the one-step method [13, 14] or the two-step method [12, 15, 16]. Two systems of real-time assays are widely used for the detection of RABV and lyssaviruses: the SYBR Green real-time RT-PCR and the TaqMan real-time RT-PCR, which is to date the most common technique implemented in the laboratories working on rabies [17].

As real-time PCR assays have become routine in diagnostic laboratories and because of their prominence, there has been rapid growth of commercially available reagent systems and detection platforms which greatly increase the options available to laboratories. In this study, we evaluated several commercial master mixes in order to identify those which produce the best results using one-step and two-step real-time RT-PCR for the determination of EBLV-1. Five different systems for the generation of cDNA, five two-step PCR kits, and five one-step qRT-PCR kits were compared. The analysed performance evaluation criteria included the generation of a standard curve, reaction efficiency, analytical sensitivity, intra- and interassay repeatability as well as the costs and the practicability of kits, and thermocycling times. The goal of this study was also to determine if the one-step and two-step systems had the same reaction efficiencies for the detection of EBLV-1 and if one system was more sensitive than another using two real-time thermocyclers.

2. Materials and Methods

2.1. Rabies Virus Isolates and RNA Extraction

The European bat Lyssavirus type 1 virus (EBLV-1) was selected for this study for the generation of in vitro RNA transcript. The virus EBLV-1 (ANSES, strain numbered 05-09) was isolated in France in 2000 from a rabid bat (Eptesicus serotinus). The isolate was mouse passaged before RNA extraction.

Viral RNA was extracted from 200 μL of 10% mouse brain tissue suspension using the Iprep Pure Link Virus kit (Invitrogen, France) according to the manufacturer’s instructions. The RNA concentration was determined spectrophotometrically and the RNA was stored at −70°C until use.

2.2. Preparation of In Vitro RNA Transcripts

Briefly, a one-step RT-PCR amplification was performed as previously described [8] on 5 µL of extracted RNA (i.e., 250–500 ng) with specific rabies primers (JW12 (forward) 5′-ATGTAACACCYCTACAATG and JW6 (reverse) 5′-CARTTVGCRCACATYTTRTG). The 606 bp PCR products were purified and inserted into a pGEM T easy vector (Promega, France) according to the manufacturer’s instructions. Recombinant plasmids were purified using the PerfectPrep EndoFree Plasmid Maxi Kit (5Prime, France) and then concentrated using a step of sodium acetate/ethanol precipitation and linearised with the PstI restriction enzyme (Promega, France). The clones of PCR products were bidirectionally sequenced with sense and antisense primers T7 and SP6 by Beckman Coulter Genomics (Takeley, United Kingdom) to confirm the presence of the target insert.

In vitro transcription was performed using T7 RNA polymerase according to the manufacturer’s instructions (MaxiScript SP6/T7 kit, Ambion, France). The resulting RNA transcripts were purified as recommended by the manufacturer using 2 µL of DNAse I during 15 min at 37°C, followed by a final purification step using the RNeasy mini kit (Qiagen, France). The RNA concentration was determined by using the Qubit Fluorometer (Invitrogen, France). RNA transcripts were aliquoted to 107 copies/µL and then stored at −70°C. The RNA molecule copy number was calculated following the manufacturer’s instructions (MaxiScript SP6/T7 kit, Ambion, France) using the following formula: molecules/µL = ( g/µL RNA/[transcript length in nucleotides × 330] × 6.022·1023). The estimated number of copies was of 2.68 · 1011 for EBLV-1 RNA transcript.

The quality of RNA transcript was checked on serial tenfold dilutions (106 to 1 copie/µL) through measurements of efficiency of amplification using a two-step SYBR Green RT-PCR [12]. PCR efficiency was of 99%.

2.3. Real-Time RT-PCR Assays
2.3.1. Primers Used

Universal pan Lyssavirus primers were selected for this study. Two questionnaires, respectively, undertaken in 2011-2012 by the EURL laboratory have demonstrated that 13 out of 21 National Reference Laboratories for Rabies (NRLs) used primers JW12 and N165-146 previously described by Wakeley et al. [18]. These specific rabies primers (JW12 (forward), ATGTAACACCYCTACAATG and N165-146 (reverse), GCAGGGTAYTTRTACTCATA) were designed to detect the rabies virus N gene of all known lyssaviruses [12].

2.3.2. Two-Step RT-qPCR Assays

(1) Commercial Master Mix Kits

(a) Reverse Transcription Kits (Table 1(a)). Five different reverse transcription (RT) systems provided by five different companies and five different qPCR kits provided by the same five suppliers were tested with the two-step method. The following RT kits were compared: Iscript (IScript cDNA synthesis kit, Bio-Rad, France), QuantiTect (Quantitect Reverse transcription kit, Qiagen, France), Maxima (Maxima H Minus First Strand cDNA synthesis kit, Fermentas, France), SS Vilo (Superscript Vilo Master Mix, Invitrogen, France), and qScript (qScript cDNA Synthesis kit, Quanta, France).

(b) Two-Step SYBR Green PCR Kits (Table 1(b)). Different two-step qPCR kits were tested: SsoFast (SsoFast Evagreen Super mix kit, Bio-Rad, France), QuantiTect (QuantiTect SYBR Green PCR kit, Qiagen, France), Maxima (Maxima SYBR Green qPCR master mix, Fermentas, France), Express (Express SYBR GreenER qPCR Supermix universal, Invitrogen, France), and Perfecta (Perfecta SYBR Green Supermix, Quanta, France).

(2) Two-Step RT-qPCR Analysis. Seven 1 : 10 serial dilutions (i.e., 106 to 1 copie/µL) of the in vitro EBLV-1 RNA transcript were prepared in RNAse free water then subjected to reverse transcription using the five different RT master mixes. All RT kits were optimised with regard to the time and the temperature of incubation (Table 1(a)). Complementary cDNAs were generated from 5 µL of each dilution of EBLV-1 RNA, random primer, oligo dT, or a mix of oligo dT/random primer included in each tested kit according to the recommendations of the manufacturers. The cycling conditions and the reaction protocol for each tested RT kit are detailed in Table 1(a). Thermocycling was performed on the Mastercycler Eppendorf thermal cycler (Eppendorf, France).

Real-time PCRs were run on the thermocyclers Rotor Gene Q MDx (Qiagen, France) and Mx3005P (Agilent Technologies, France). The concentrations of the reverse (N165-146) and forward (JW12) primers were optimised for each tested kit. At least three different concentrations were examined, that is, the one recommended by the manufacturer, one below, and one above the recommended primer concentration using the qPCR conditions described in Table 1(b). The optimised concentration of primers is recorded for each tested qPCR kits in Table 1(b). Reactions were performed in triplicate in a total volume of 20 µL or 25 µL, following the manufacturer’s instructions (Table 1(b)).

The following thermal profile was used: PCR initial activation step at 95°C for 30 sec (SsoFast), 15 min (QuantiTect), 10 min (Maxima), 2 min (Express), or 3 min (Perfecta) according to the manufacturer’s recommendations. The cycler conditions, performed as previously described by Hayman et al. [19], were the same for all assays: 45 cycles of three-step cycling consisting of denaturation at 94°C for 30 sec, annealing at 55°C for 30 sec, and extension at 72°C for 30 sec.

2.3.3. One-Step qRT-PCR Assays

(1) Commercial qRT-PCR Kits (Table 1(c)). Five commercial one-step kits provided by four suppliers were tested: QuantiTect-1 step (QuantiTect SYBR Green RT-PCR kit, Qiagen, France), Rotor Gene-1 step (Rotor-Gene SYBR Green RT-PCR kit, Qiagen, France), Verso-1 step (Verso SYBR Green one-step qRT-PCR kit, Fermentas, France), SSIII Platinium-1 step (SuperScript III Platinium SYBR Green One-step qRT-PCR kit, Invitrogen, France), and qScript-1 step (qScript One step SYBR Green QRT-PCR kit, Quanta, France).

(2) One-Step qRT-PCR Analysis. To compare the five master mixes, the assays were performed in triplicate using seven tenfold dilutions (i.e., 106 to 1 copies/µL) of EBLV-1 RNA. PCR was performed using a total volume of 25 µL containing 2 µL of serial dilutions of EBLV-1 RNA and the master mix components ( = 23 µL) from each representative kit, which were prepared according to the respective manufacturer’s instructions (Table 1(c)). The concentrations of the reverse (N165-146) and forward (JW12) primers were optimised for each tested kit (Table 1(c)). At least three different concentrations were examined, the one recommended by the manufacturer, one below, and one above the recommended primer concentration (Table 1(b)).

Real-time RT-PCR assays were performed on the thermocycler Rotor Gene Q MDx and Mx3005P using the same thermocycling conditions for the five kits (i.e., 45 cycles of 30 sec-94°C, 30 sec-55°C and 30 sec-72°C). For each tested kit, the DNA polymerase activation step was performed as recommended by the supplier (Table 1(c)).

2.3.4. Data Collection and Analysis

PCR efficiency and coefficient of determination () values were calculated by the software Rotor Gene Q Series and Mx3005Pro, respectively.

Negative and positive controls were included in each assay, in which a threshold setting (Ct) of 0.03 was used as the reference for the Rotor Gene Q MDx thermocycler. A threshold setting of 300 was used as the reference for the Mx3005P thermocycler for all tested kits except for one two-step kit (Express) for which a threshold setting of 0.05 was used.

2.4. Determination of the Performance of the Method

The performance of the method was determined for all tested kits following OIE recommendations [20] and those of the French Agency for Standard Operating Procedure for PCR experimental design [21]. Performance testing was conducted for the two real-time platforms.

2.4.1. Determination of PCR Efficiency

A 106 to 103 copies/µL dilution range corresponds to the linear dynamic range for the ten tested kits. To determine the PCR efficiency for each tested kit, a standard curve was plotted based on Ct values obtained from samples containing 106 to 103 copies/µL against the log of the estimated RNA copy number in the sample. The coefficient of determination () was calculated and considered as suitable when not lower than 0.99. The slope of the standard curves was used for the determination of PCR efficiency (). The efficiency was considered satisfactory when it is not lower than 90% and not above 110% [22].

2.4.2. Determination of the Limit of Detection at 95%

The limit of detection at 95% (LOD 95%) which corresponds to the lowest RNA concentration that could be detected with 95% confidence was calculated using the inverse standard normal distribution calculation [21]. The LOD 95% was calculated using the Probit analysis based on the results of three runs of eight repetitions of six dilutions each of EBLV-1 RNA in RNase-free water ( = 144 samples tested). The six dilutions (cDNA and RNA) were selected surrounding the limit of detection of real-time PCR assays.

On the Rotor Gene Q MDx gene cycler, 103 to 25 copies/sample were tested with the kit Rotor Gene-1 step, 103 to 50 copies/sample for qScript-1 step/SSIII Platinium-1 step, 500 to 10 copies/sample for Verso-1 step, 50 to 1 copies/sample for Quantitect-1 step, 250 to 5 copies/sample for Perfecta, 250 to 5 copies/sample for QuantiTect, 102 to 2.5 copies/sample for Maxima, 100 to 0.5 copies/sample for Sso Fast, and 100 to 0.5 copies/sample for Express.

On Mx3005P cycler, 2500 to 100 copies/sample were tested with the kit qScript-1 step, 250 to 5 copies/sample for SSIII Platinium-1 step/Verso-1 step, 50 to 1 copies/sample for Rotor Gene-1 step/Quantitect-1 step, 500 to 10 copies/sample for QuantiTect, 250 to 5 copies/µL for Maxima/Sso Fast/Perfecta, 250 to 5 copies/sample for Perfecta, and 100 to 2.5 copies/sample for Express.

Three independent assays were undertaken under identical laboratory conditions.

2.4.3. Evaluation of Reproducibility

To evaluate the reproducibility of the ten kits, inter- and intraspecific assay reproducibility were assessed using the coefficient of variation (CV) of the Ct values for the lowest RNA concentration showing 100% positive results. The intra-assay repeatability was determined using three independent runs of eight replicates of EBLV-1 ( = 24 samples tested). The interassay repeatability was assessed for the same serial replicates in three independent assays using identical laboratory conditions. CVs expressed as percentages were obtained by dividing the standard deviation of each tested sample by the mean of the cycle threshold values and multiplying that result by 100.

3. Results

3.1. Differences in RNA Detection Levels Using Two-Step Assays
3.1.1. Reverse Transcription Kits

Of the five reverse transcription kits tested in combination with the SSoFast kit for cDNA amplification, the SuperScript Vilo yielded greater sensitivity and resulted in a detection limit of 10 copies/µL (3 positive samples out of 3 tested). The efficiency of amplification was of 98%. The four other RT kits (i.e., kits Quantitect, Maxima, SS Vilo, and qScript) resulted in a detection of 100 copies/µL. The amplification efficiency varied between 98 and 104%. The -intercept for all reverse transcription kits tested in combination with the qPCR SsoFast kit varied between 35.13 and 37.46.

3.1.2. Two-Step PCR Kits

All optimised two-step qPCR assays tested in combination with the Iscript RT showed similar sensitivity and enabled detection of at least 100 copies/µL of EBLV-1 on the Rotor Gene Q MDx gene cycler. The efficiency of amplification which was satisfactory for all tested kits varied between 90 (i.e., kit Perfecta) and 99% (i.e., kits SSo Fast, Quantitect SG, Maxima SG, and Express) with an -intercept varying between 36.03 and 38.57.

3.1.3. Comparison of Two-Step RT-qPCR Kits Provided by the Same Manufacturer

Table 2 details the results of the comparison of the five two-step kits.

(i) Rotor Gene Q MDx. Of the five PCR kits tested in combination with the reverse transcriptases provided by the same manufacturer, one RT-qPCR assay (SuperScript Vilo in combination with qPCR Express kit) yielded greater sensitivity and showed a detection of at least 10 copies/µL (Table 2). All amplicons investigated with the two-step method using qPCR kits and RT kits from the same provider showed satisfactory efficiency of amplification (100 ± 10%). The -intercept for all tested kits varied between 34.73 and 39.55.

(ii) Mx3005P. Of the five tested RT-qPCR kits, one RT-qPCR assay (Maxima RT/qPCR Maxima) yielded greater sensitivity and showed a detection of at least 10 copies/µL. All RT-qPCR assays showed satisfactory efficiency varying between 93 and 107% with detection of at least 100 copies/µL. The -intercept varied between 38.01 and 41.83 for all tested kits.

3.2. Differences in RNA Detection between the Five Kits Tested Using the One-Step Method

Table 3 details the results of the comparison of the five one-step kits.

(i) Rotor Gene Q MDx. Three optimised qRT-PCR assays revealed poor sensitivity and enabled detection of at least 103 copies/µL. Of the five kits tested, two kits (QuantiTect-1 step and Verso-1 step) yielded greater sensitivity with the detection of at least 10 copies/µL (3 positive samples out of 3 tested). All kits showed a satisfactory efficiency varying between 94% and 104%. The -intercept varied between 32.78 and 37.67 for the five tested one-step kits.

A high presence of Primer-Dimer was shown for low RNA concentrations for three kits: SSIII Platinium-1 step, Verso-1 step, and qScript-1 step.

(ii) Mx3005P. Of the five one-step kits tested using the Mx3005P cycler, three optimised one-step kits (i.e., Quantitect-1 step, Rotor Gene-1 step, and SSIII Platinium-1 step) revealed good sensitivity with the detection of at least 10 copies/µL. The two other optimised one-step assays (i.e., Verso-1 step and qScript-1 step) revealed poor sensitivity with a detection of 102 and 103 copies/µL, respectively. The amplification efficiency was satisfactory for all kits (94–100%) except for the qScript one-step kit (efficiency of 87%). The -intercept varied between 36.80 and 40.74 for all tested kits except for the qScript kit (Intercept of 40.74).

3.3. Comparison of Assay Performance
3.3.1. Limit of Detection at 95% for One-Step and Two-Step Methods

The results of LOD 95% for the ten kits tested using two-step and one-step methods are recorded in Table 4.

(i) Rotor Gene Q MDx. The results showed an LOD 95% for two-step and one-step kits ranging from 41 to 171 copies/µL and from 20 to 497 copies/µL, respectively (Table 4). Of the five commercial master mixes tested using the two-step qPCR, the RT SuperScript Vilo in combination with the Express kit yielded greater sensitivity with an LOD 95% of 41 copies/µL. Maxima in combination with the RT Maxima and Perfecta in combination with the RT qScript ranked second and third with detection of 78 and 88 copies/µL, respectively, followed by the SsoFast and QuantiTect kits which demonstrated the poorest levels of detection with an LOD 95% of 110 and 171 copies/µL, respectively.

In contrast, the one-step qRT-PCR kit Quantitect-1 step yielded the best levels of detection with an LOD 95% of 20 copies/µL. The four other tested one-step kits yielded poor detection with an LOD 95% varying between 127 and 497 copies/µL.

(ii) Mx3005P. The LOD 95% for one-step and two-step kits ranged from 15 to 981 copies/µL and 45 to 160 copies/µL, respectively. Of the five commercial master mixes tested using the two-step qPCR, the RT SuperScript Vilo in combination with the Express kit yielded greater sensitivity with an LOD 95% of 45 copies/µL. Perfecta in combination with qScript RT and Maxima in combination with RT Maxima ranked second and third, with a detection of 67 and 76 copies/µL respectively, followed by the the SsoFast and QuantiTect kits which demonstrated the poorest levels of detection with an LOD 95% of 88 and 160 copies/µL, respectively.

Of the five tested one-step kits, two kits (i.e., Rotor gene-1 step and Quantitect-1 step) yielded the best levels of detection with an LOD 95% of 15 and 22 copies/µL, respectively. SSIII Platinium-1 step ranked third with an LOD 95% of 50 copies/µL followed by Verso-1 step (LOD 95% of 101 copies/µL) and qScript-1 step (981 copies/µL).

3.3.2. Reproducibility of One-Step and Two-Step Methods

Table 5 shows the analysis results of reproducibility of one-step and two-step assays.

(i) Rotor Gene Q MDx. For all optimised one-step or two-step PCR assays, the interassay CVs were lower than 10%, demonstrating good reproducibility for all tested kits [23]. The interassay CVs for the two-step kits and the one-step kits ranged from 1.74 to 2.95 and 1.35 to 4.27, respectively, while the intra-assay CVs ranged from 1.35 to 3.5 and 0.79 to 6.72 for two-step and one-step kits, respectively (Tables 5(a) and 5(b)). In analysing the intra-assay CVs, a somewhat similar variability was shown for two-step and one-step reactions.

The interassay CVs for the most efficient two-step kit (i.e., SuperScript Vilo in combination with qPCR Express) and the most efficient one-step kit (i.e., Quantitect-1 step) ranged from 1.95 to 3.36, respectively, while the intra-assay CVs ranged from 1.85 to 2.11 and 0.79 to 2.16 for two-step and one-step kits, respectively (Tables 5(a) and 5(b)).

(ii) Mx3005P. For all optimised one-step or two-step PCR assays, the interassay CVs were lower than 10%, demonstrating good reproducibility for all tested kits. The interassay CVs for the two-step and one-step kits ranged from 2.14 to 3.3 and 0.84 to 4.5, respectively, while the intra-assay CVs ranged from 1.23 to 4.22 and 0.38 to 4.7 for two-step and one-step kits, respectively.

3.4. Practicability of the Different Assays, Costs, and Time

Table 6 shows a practicability assessment of the different real-time assays including a comparison of cost, pipetting steps, and thermocycling times. Total reaction times for the ten real-time assays ranged from 2h42 to 3h08 for two-step kits and 2h18 to 2h57 for one-step kits, with the one-step SSIII Platinium kit requiring the shortest time, and two-step Maxima kit the longest, regardless the machine used. The kits were ranked from 1 to 10 based on the cost per PCR reaction in increasing order, from €1.08 (least expensive = 1) to €12.25 (most expensive = 10). Overall, of the 10 master mix kits tested, the one-step kits were cheaper than the two-step kits (Table 6). For the one-step kits, qScript was the least costly followed by the Rotor Gene-1 step, Verso-1 step, SSIII Platinium-1 step, and the Quantitect-1 step, which was the most expensive of all the tested kits. The Express master mix kit with SuperScript Vilo was the most expensive per assay of the two-step kits evaluated in this study. Of the two-step kits, the least expensive was Perfecta, followed by Maxima, QuantiTect, and Sso Fast.

4. Discussion

The first practical real-time PCR, the 5′ nuclease assay, was established in 1993 combining the exponential PCR amplification of a specific transcript with the monitoring of newly synthesised DNA in each PCR cycle performed [24]. Over the past several years, real-time PCR has become the leading tool for the detection and quantification of nucleic acids. Since the first publications of real-time RT-PCR describing the rapid detection of rabies virus in 2004 [10, 25], various protocols for molecular diagnosis of Lyssavirus using SYBR Green and/or TaqMan probes have been published [11, 12, 16, 26, 27]. Although molecular techniques are not currently recommended by the international authorities for routine diagnosis of rabies, real-time PCR is increasingly used. The availability of commercial master mix kits has increased over the past decade, and diagnostic laboratories willing to implement real-time PCR are now faced with identifying the most suitable kit for their real-time PCR applications. It has been demonstrated that the choice of master mix reagents, the concentration of reaction mix components, such as primers, probes, analytical platforms linked to the real-time detection platform, the different chemistries, and the methodology used (one-step versus two-step systems) can impact the sensitivity and consistency of results for real-time PCR assays [28].

The objective of this study was to evaluate the sensitivity, efficiency, and reproducibility of one-step and two-step systems for the detection of EBLV-1. This virus species was selected for this study for the generation of in vitro RNA transcript. This bat virus is widely isolated on European bats, the vast majority of rabies cases in bats in Europe being attributed to EBLV-1. The increased interest in bats as a potential host for zoonotic viruses has resulted in the detection of many new Lyssavirus species in the past ten years [29]. In our study, we selected five different cDNA generation systems and ten commercial kits, that is, five one-step kits and five two-step kits. These kits are commonly used by National Reference Laboratories that conduct rabies diagnosis (data not shown). Our results demonstrated that there was little difference in reaction efficiency, values, or intra- and interreproducibility between one-step and two-step methods. In our experience, regardless of the real-time cycler used, one-step qRT-PCR showed better limit of detection at 95% than the optimised two-step assays using pan Lyssavirus primers.

The RT reaction is a key step in quantitative two-step RT-qPCR. RT priming strategy, dynamic range, and the RT enzyme, which are prime considerations for a successful real-time RT-PCR assay, are all important for ensuring that mRNA expression levels are accurately represented in the resulting cDNA [30]. For many quantitative applications, the MMLV RT (Moloney Murine Leukemia Virus reverse transcriptase) is described as the enzyme of choice as its cDNA synthesis rate is up to 40-fold greater than that of AMV (Avian Myeloblastosis Virus) reverse transcriptase [23]. Few results comparing the sensitivity of reverse transcriptases are currently available [31]. In this study, five different cDNA generation systems were compared (e.g., 4 different MMLV RTs and a mix of Omniscript and Sensiscript RTs), each kit containing unspecific target gene primers (e.g., random hexamer ( = 3 kits), a mix of random hexamers, and oligo dT ( = 2 kits)). By varying the RT chemistry and the RT priming strategy, we showed that the SuperScript Vilo reverse transcriptase which is an engineered version of MMLV RT has provided the highest sensitivity with a gain of 1 log over the other systems of cDNA generation. These results are concordant with those of the literature [23, 32, 33], demonstrating the key role of the reverse transcriptase kit in a sensitive real-time two-step assay and providing the highest MMLV reverse transcriptase performance.

In addition to assay performance criteria, another goal of this study was to compare the performance of each kit with the cost, the practicability of each tested master mix, and the presence or absence of Primer-Dimer for low DNA concentrations. Interestingly, the one-step QuantiTect SYBR Green RT-PCR kit, which was shown the more efficient one-step kits, is also one of the most expensive and required the longest thermocycling time while the combination of SuperScript VILO reverse transcriptase and the qPCR Express kit which was found to be the most efficient of the two-step kits using the two thermocyclers is also the most expensive of the two-step kits. No difference in run duration was shown between the best two-step kits, SuperScript VILO/qPCR Express and Maxima H Minus RT/qPCR Maxima, and the one-step kit, QuantiTect SYBR Green RT-PCR, confirming that all the kits are suitable for RNA detection, regardless of the thermocycling times. However, when using the thermocycler Rotor Gene MQDx, the real-time one-step SYBR Green assays with universal pan Lyssavirus revealed a high presence of Primer-Dimers for three out of five one-step kits tested especially when RNA concentration was low (below 100 copies/µL) compared to two-step kits (data not shown). The results of such techniques should be interpreted with attention, since interpretation can be difficult, especially for low concentrations of samples.

Few studies have been performed comparing one-step and two-step methods, the chemistries (Taqman probes versus SYBR green) or the platforms for detection of infectious agents. There are advantages and disadvantages to both methods, as well as to the use of SYBR green or fluorogenic probes. The main advantage of the one-step method is that it is less time consuming and requires no user intervention, therefore minimising the chance of pipetting errors and cross contamination. The main advantage to two-step RT-qPCR is that typically random hexamer or oligo dT primers are used in an RT reaction in a separate tube allowing the archiving of samples for further testing of different species of rabies or for future testing of other genes. Moreover, in theory the one-step method should offer higher or at least the same sensitivity as a two-step method because of the use of gene-specific primers. In our experience, of the five one-step method kits tested, we found three that yielded satisfactory analytical sensitivity with an LOD 95% of 15–50 copies/µL. Our results are concordant with previous results undertaken by Fischer et al. [32]. Based on the analysis of Ct values, a study of real-time RT-PCRs on infected brain samples [32] showed that three one-step SYBR Green kits were more sensitive than the two two-step kits.

The sensitivity of real-time PCR assays is mainly determined by the master mix reagents, but also by other factors, such as the platform used. The performance of the thermocycler has a critical influence on PCR efficiency. Previous studies have reported significant variability in PCR efficiency and results among different types of thermocyclers [3436]. Considering the various types of real-time equipment used in National Reference Laboratories involved in rabies diagnosis, the ten master mixes were evaluated for intermediate reproducibility on two real-time platforms with varying throughput capacities. These two platforms differ on thermal engine (heating block technology based on the Peltier effect versus heat exchange technology which permit more rapid thermal ramp rates than blocks). Both real-time platforms are currently used by half of the National Reference Rabies laboratories (i.e., 9/19). We showed that the more efficient one-step kit was the one-step QuantiTect SYBR Green RT-PCR kit with an LOD 95% of 20 and 22 copies/µL on the two real-time cyclers “Rotor Gene Q MDx, Mx3005P,” respectively. The reverse transcription kit SuperScript VILO in combination with the EXPRESS SYBR GreenER kit is revealed to be the most sensitive of the two-step kits offering a limit of detection of 41 and 45 copies/µL, respectively. Previous studies have reported the influence of the thermocyclers. Buzard et al. demonstrated that certain combinations of commonly used master mixes and instruments are not as reliable as others for the detection of low DNA concentrations [28]. In our experiment, the LOD 95% of Rotor Gene-1 step from QIAGEN operated with the Rotor Gene Q MDX thermocycler was 497 copies/sample whereas it resulted in 15 copies/sample with the Mx3005P thermocycler. Our results demonstrated the pivotal influence of the thermocycler on PCR performance and that a master mix that showed high performance for one machine may not necessarily work on another. Our findings further show that PCR protocols need to be optimised for different instruments and that validation of PCR protocols should include the intermediate reproducibility studies as recommended by the World Organization for Animal Health [37].

PCR protocols need to be validated, since a large variety of parameters can influence the outcome of PCR amplification. PCR results generated by one lab are hardly reproducible by another, even under identical assay conditions. Due to the high sensitivity of real-time PCR assays, if they are not performed by highly trained molecular biology staff, there is a high risk of sample or test contamination, resulting in false positives. For these reasons, although these molecular tests have the highest level of sensitivity, their use is currently not recommended for routine postmortem diagnosis of rabies [4] due to the high levels of false positive or false negative results [7]. The considerable development of molecular techniques in the 2000s has resulted in a wide variation in methods and these techniques have become increasingly important for decision-making in rabies case management. However, it is essential that laboratories employing PCR-based assays apply very stringent laboratory quality control standards and that they validate these highly sensitive techniques following international guideline recommendations [37].

5. Conclusion

With the optimisation of PCR on two real-time instruments as well as the optimization of the RT step when testing the two-step method, we showed that one-step PCR is more sensitive than the two-step method, regardless of the machine used. We showed that the more efficient one-step kit was the one-step QuantiTect SYBR Green RT-PCR kit with an LOD 95% of 20 and 22 copies/µL on the two real-time cyclers “Rotor Gene Q MDx, Mx3005P,” respectively. PCR assays demonstrated the crucial influence of the thermocycler on PCR performance for the detection of EBLV-1, despite the optimisation of PCR assays, and that a master mix which performs well on one machine may not necessarily work as well on another. In conclusion, PCR protocols should be systematically optimised for different instruments and validated following the recommendations of the World Organization for Animal Health.

Abbreviations

Ct:Threshold cycle
CV:Coefficient of variation
EBLV-1:European bat Lyssavirus type 1
LOD 95%:Limit of detection at 95%
PCR:Polymerase chain reaction
RT:Reverse transcription
:Coefficient of determination.

Conflict of Interests

The authors declare that they have no competing interests.

Acknowledgments

The authors wish to thank the European Commission and ANSES for their financial support of this study. The authors also wish to thank Mélanie Biarnais and Marie-José Duchêne for their contributions.