Abstract

Introduction. The diagnosis of pulmonary infection and the identification of pathogens are still clinical challenges in immunocompromised patients. Metagenomic next-generation sequencing (mNGS) has emerged as a promising infection diagnostic technique. However, its diagnostic value in immunocompromised patients needs further exploration. Purposes. This study was to evaluate the diagnostic value of mNGS compared with comprehensive conventional pathogen tests (CTs) in the etiology of pneumonia in immunocompromised patients and immunocompetent patients. Methods. We retrospectively reviewed 53 patients who were diagnosed with pneumonia from May 2019 to June 2021. There were 32 immunocompromised patients and 21 immunocompetent patients with pneumonia who received both mNGS and CTs. The diagnostic performance was compared between mNGS and CTs in immunocompromised patients, using the composite diagnosis as the reference standard. And, the diagnostic value of mNGS for mixed infections was further analyzed. Results. Compared to immunocompetent patients, the most commonly pathogens, followed by Cytomegalovirus, Pneumocystis jirovecii and Klebsiella pneumoniae in immunocompromised patients. Furthermore, more mixed infections were diagnosed, and bacterial-fungal-virus coinfection was the most frequent combination (43.8%). mNGS can detect more types of pathogenic microorganisms than CTs in both groups (78.1% vs. 62.5%, and 57.1% vs. 42.9%, ). The overall diagnostic positive rate of mNGS for pathogens was higher in immunocompromised patients (). In immunocompromised patients, a comparable diagnostic accuracy of mNGS and CTs was found for bacterial, fungal, and viral infections and coinfection. mNGS had a much higher sensitivity for bacterial infections (92.9% vs. 50%, ) and coinfections (68.8% vs. 48.3%, ), and it had no significant advantage in the detection of fungal infections, mainly due to the high sensitivity for Pneumocystis jirovecii in both groups. Conclusion. mNGS is more valuable in immunocompromised patients and exhibits apparent advantages in detecting bacterial and mixed infections. It may be an alternative or complementary diagnostic method for the diagnosis of complicated infections in immunocompromised patients.

1. Introduction

Pneumonia is a global public health problem due to its high morbidity and mortality [1, 2]. Pneumonia in immunocompromised hosts can lead to more susceptibility to different pathogens ranging from common to opportunistic pathogens. The causative agent of up to 60% of infectious diseases remains unknown based on clinical phenotype [3, 4]. Finding the causative pathogens in the general population is associated with decreased morbidity and mortality. Comprehensive conventional pathogen tests (CTs) (blood, sputum, bronchoalveolar lavage fluid (BALF), etc.), including bacterial, fungal, acid-fast bacilli smears, cultures, and antigen/antibody-based testing were routinely used in clinic. However, the current diagnostic efficiency of traditional pathogen detection is only 30%–40% [5]. It was limited by time consumption, repeated inspection, and poor detection rate.

Metagenomic next-generation sequencing (mNGS) is a high-throughput sequencing method that can widely analyze the microbiome of clinical samples and has the advantages of direct specimen detection, broad pathogen coverage, and rapid feedback [6, 7]. It has been reported to identify pathogens in various specimen types such as bloodstream respiratory, central nervous system, and focal tissue infection [810]. Moreover, a large number of rare pathogens have been detected by the mNGS method, which provides a timely and effective way for the diagnosis of intractable cases [1113]. However, the research on the diagnostic performance of mNGS in immunocompromised pneumonia is still relatively limited [1417]. The majority of studies have focused on the comparison of the diagnostic performance of mNGS and blood culture etiology, and few studies have investigated the difference between CTs and mNGS. There is also a lack of studies comparing the etiological diagnostic performance of mNGS in immunocompromised and immunocompetent patients.

This study was to evaluate the diagnostic value of mNGS compared with CTs in the etiology of pneumonia in immunocompromised patients and immunocompetent patients. We aimed to analysis the diagnostic performance of mNGS in bacterial, fungal, and virus infections. Furthermore, the diagnostic value of mNGS for mixed infections was further analyzed.

2. Materials and Methods

2.1. Study Design and Participants

A retrospective study recruited 53 study subjects between May 2019 and June 2021 who were immunocompetent and non-HIV immunocompromised adult patients (age ≥ 18 years) with pneumonia (Figure 1). The patients were hospitalized in Peking University First Hospital who were admitted if (1) they had one or more immunocompromised status; (2) they were diagnosed with pneumonia based on the Infectious Diseases Society of America (IDSA)/American Thoracic Society (ATS) criteria [18]; (3) they had BALF and other relevant samples (blood, sputum, tissue, etc.) available for standard procedures (Figure 2); (4) CTs include two or more pathogenic tests (bacterial, fungal, acid-fast bacilli smear and culture, Grocott’s methenamine staining (GMS), (1,3)-β-D-glucans (G test), galactomannan antigen (GM), TB-spot, and GeneXpert, etc.) (Figure 2). Immunocompromised status should meet one or more of the following [19]: (1) using corticosteroid therapy (≥20 mg/d prednisone or equivalent, continuous ≥14 days or cumulative dosage of 600 mg), disease-modifying antirheumatic drugs, biological immune modulators, or other immunosuppressive agents for more than 30 days; (2) active malignancy or receiving cancer chemotherapy; (3) solid organ transplantation; (4) hematopoietic stem cell transplantation; (5) primary or acquired immune deficiency diseases. Patients were excluded if they met any of the following criteria: (1) age < 18 years old; (2) HIV infection; (3) clinical data were incomplete. Baseline data were collected from the clinical electronic medical record system, including demographic characteristics, hospital length of stay, comorbidities, immunosuppressive states, clinical symptoms, signs, laboratory indicators (blood routine, procalcitonin, hypersensitive C-reactive protein, erythrocyte sedimentation rate, T lymphocyte subsets), microbiological testing, chest imaging, treatment process, and prognosis.

Patients were divided into an immunocompromised group and an immunocompetent group according to immune function. Moreover, the diagnostic value of mNGS and CTs was compared (including two or more conventional testing methods).

2.2. Microbiological Testing and Pathogenic Analysis

The specimen (BALF, blood, sputum, bronchoalveolar lavage fluid, and tissue) was divided into small portions and paired for CTs and mNGS testing (Table S1). Some specimens were sent to CapitalBio Corporation, Beijing, China, for the mNGS analysis. Once the laboratory receives the specimens, the testing company will process the specimens immediately, performing nucleic acid extraction, library preparation, high-throughput sequencing, and bioinformatics analysis. The interpretation of results mainly depends on relevant standard procedures. A positive result from mNGS data would be if the coverage rate of bacteria (Mycobacteria excluded) or viruses (species level) scored 10-fold higher than that of any other microorganism, and the coverage rate of fungi was 5 times higher than that of any other fungus [4, 20]. For Mycobacterium tuberculosis (MTB), it was considered positive when at least 1 read was mapped to the species or genus level [21]. The other specimens were sent to our hospital’s microbiological laboratory using CTs for pathogenic analysis.

2.3. Conventional Pathogenic Tests

In addition to the etiological testing of the above-mentioned specimens, other related samples (sputum, blood and urine) for CTs, including bacterial, fungal smear and culture, acid-fast stain, GM, G test, Cryptococcus neoformans antigen, TB-spot, GeneXpert, real-time polymerase chain reaction (PCR) (Cytomegalovirus (CMV), EB virus, influenza virus, respiratory syncytial virus, Legionella, Mycoplasma, and Chlamydia spp), GMS (Pneumocystis jirovecii), and direct microscopic examination of specimens. The results of the CTs were interpreted according to the standard procedure [22, 23].

2.4. mNGS Testing
2.4.1. Sample Collection, Processing, and Nucleic Acid Extraction

Specimens were collected and immediately sent to the testing company (CapitalBio Corporation, Beijing, China) for about 3 hours. Total nucleic acid was extracted from 3-4 ml of BALF, sputum, or pleural effusion and from 5 ml of blood samples. In brief, blood samples were collected in tubes of 5 ml of ethylenediaminetetraacetic acid and plasma was separated at 1600 g for 10 min. 3-4 ml of sputum, bronchoalveolar lavage solution (BALF), or pleural effusion was collected in sterile tubes. Sputum samples were liquefied using 0.1% dithiothreitol for 30 min at room temperature.

2.4.2. Library Preparation and High-Throughput Sequencing

DNA was extracted using the QIAamp DNA Microbiome Kit (Cat#51704, Qiagen, Germany). RNA was extracted using the QIAamp Viral RNA Mini Kit (Cat#52904, Qiagen, Germany). Extracted RNA was reverse transcribed using random primers, and cDNA was combined with DNA from the same clinical sample for sequencing library preparation. The pooled nucleic acids were digested to a size of 200–300 bp, and a sequencing library was constructed by end repair, adapter ligation, and PCR amplification. Sequencing templates were further prepared using the One Touch2 System (Life Technologies, CA, USA) and sequenced on a BioelectronSeq 4000 sequencer (CapitalBio Corporation, Beijing, China) after quality control.

2.4.3. Bioinformatics Analysis

Firstly, quality control was taken from the raw sequencing data and reads less than 50 bp in length and of low quality were removed. The remaining sequencing data were depleted of human host sequences by mapping to the human reference genome grch38 using Bowtie2 software (https://bowtie-bio.sourceforge.net/). Then, the nonhuman sequences contained 13992 bacterial, 1659 fungal, 13000 viral, and 287 parasitic pathogens, which were classified by simultaneously aligning genomic sequence databases downloaded from the National Center for Biotechnology Information (https://ftp.ncbi.nlm.nih.gov/genomes/) and Pathosystems Resource Integration Center (PATRIC) databases (Bacterial and Viral Bioinformatics Resource Center | BV-BRC). Following the above steps, we reviewed data from various types of samples from healthy individuals and calculated relevant reference values (including hit reads number and coverage of all bacteria, fungi, viruses, and parasites detected) to identify suspected pathogens. Moreover, the pathogens detected in the water samples of the negative control were removed from the results of the clinical samples. Lastly, the list of suspected pathogens, the number of reads, and genome-level coverage are counted as final etiological test results.

2.4.4. Final Clinical Diagnoses

The final clinical diagnosis was based on clinical manifestation, laboratory tests, chest radiology, microbiological tests (including CTs and mNGS), and antibiotic treatment response. Pathogens were classified into 4 categories according to mNGS: (1) definite: BALF or blood or sputum mNGS result is consistent with results from CTs (BALF/blood/sputum culture, nucleic acid-based testing, and pathological examination) performed within 7 days of specimen collection, based on clinical manifestation, chest radiology, and laboratory findings; (2) probable: mNGS pathogen is likely the cause of pneumonia according to clinical, radiologic, or laboratory findings, but the mNGS result [10, 24] was consistent with CTs; (3) possible: mNGS result has pathogenic potential and is consistent with clinical presentation but other explanation is more likely; (4) unlikely: pathogens detected by mNGS has pathogenic potential but is not consistent with clinical presentation [24]. The clinical pathogenic microorganisms were defined as (1) + (2).

2.4.5. Statistical Analysis

Continuous variable data, if normally distributed, were expressed using the mean (mean ± standard deviation (SD)). We used the median (interquartile range) if the data were not normally distributed and compared the two groups using a t-test or Mann–Whitney U Tests. Categorical variables were expressed as percentages (%), and comparisons between two groups were made by Fisher's or chi-squared test. All data analyses above were performed using SPSS 23.0. Then, we used the clinical composite diagnosis as the gold standard. Sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), and 95% confidence intervals were calculated using VassarStats and GraphPad software. The McNemar test was used to compare the diagnostic performance of CTs and mNGS.

3. Results

3.1. Demographic Characteristics

Based on the inclusion criteria, we excluded 84 patients. Fifty-three patients with pneumonia were screened out of 137 patients. Twenty-one immunocompetent patients and 32 immunocompromised patients were included in the study. The patient characteristics are presented in Table 1. There were no significant differences between immunocompetent and immunocompromised patients in terms of age (60 vs. 62.5, ), gender (13 vs. 19, ), smoking (6 vs. 14, ), drinking (5 vs. 13, ), oxygenation index (355.7 vs. 291.6, ), and the incidence of mechanical ventilation (2 vs. 9, ). The hospital length of stay was longer in immunocompromised patients than in immunocompetent patients (26.5 vs. 8, ). Among serological indicators, lymphocyte count (0.5 vs. 1.1, ), serum creatinine (89.8 vs. 64, ), and B cell count (33.1 vs. 107, ) were lower in immunocompromised patients.

Among the 53 cases, mNGS and CTs were used to detect the pathogens. Specimens tested by CTs were divided into cultures and noncultures. Among the culture specimens, BALF cultures were performed in 43, sputum cultures in 28, and blood cultures in 20. The other specimens were included by bronchial washing fluid, bronchial secretion, tissue, and so on. In nonculture specimens, antigen testing and serology testing were performed in 49, BALF tests in 24, and bronchial brushing fluid tests in 21. The main samples tested by mNGS are 46 BALF specimens, 4 blood specimens, and 1 sputum specimen (Figure 2).

3.2. Pneumonia Pathogens in the Immunocompromised Patients

Pathogens were detected in 45 of the 53 patients. All detected bacterial, fungal, and viruses are listed in Figure 3. In immunocompromised patients, the most commonly detected bacteria were Klebsiella pneumoniae, Staphylococcus, and Pseudomonas aeruginosa. The most detected fungi were Pneumocystis jirovecii, Aspergillus, and Candida species. And, Cytomegalovirus, EB virus, respiratory syncytial virus, and enterovirus were the most frequently detected viruses. In immunocompetent patients, the most commonly detected bacteria were Klebsiella pneumoniae, Streptococcus pneumonia, and Acinetobacter baumannii. The most detected fungus was Candida. And the EB virus was the most frequently detected virus. Overall, Cytomegalovirus, Pneumocystis jirovecii, Klebsiella pneumoniae, and Staphylococcus were the most detected pathogens in immunocompromised patients. Compared with immunocompetent patients, Pneumocystis jirovecii was found more in immunocompromised patients (χ2 = 3.918, ). Twenty-four (45.3%) patients had mixed infections among 53 patients with pneumonia. Although the comparison of mixed infections between the two groups was not statistically significant, bacterial-fungal-viral infections (43.8%) were the most frequent combinations in immunocompromised patients (Figure 4). A total of 16 patients had mixed infections that occurred in immunocompromised patients, which included 7 bacterial-fungal-viral infections, 3 fungal-viral infections, 3 bacterial-fungal infections, 2 bacterial-bacterial infections, and 1 bacterial-viral infection (Figure S1).

3.3. Diagnostic Performance of mNGS in Immunocompromised Patients

The diagnostic positive rates of mNGS and CTs in the two groups of patients are shown in Figure 5(a). There were statistically significant differences in the positive rates of mNGS and CTs between the two groups of patients (). The diagnostic positive rate of mNGS was higher than that in the immunocompetent group (78.1% vs. 57.1%, ). The kappa values were low in immunocompromised and immunocompetent patients (0.055 and 0.347) (Figure 5(b)).

In immunocompromised patients, mNGS and CTs had comparable diagnostic accuracy rates for different pathogens. mNGS can detect more pathogen species than CTs (Figure S2). It showed a higher sensitivity than CTs (92.9% vs. 50%, ) in bacterial detection. The PPV and NPV of the mNGS were 72.2% (95% CI, 46.4–89.3%) and 92.9% (95% CI, 64.2–99.6%), respectively. In fungi detection, the sensitivity of mNGS was 100% (95% CI, 51.7–100%) and the specificity of mNGS was 92.3% (95% CI, 73.4–98.7%). There was no significant difference between mNGS with CTs. The PPV and NPV of the mNGS were 75% (95% CI, 35.6–95.5%) and 100% (95% CI, 82.8–100%), respectively, for fungi detection. The sensitivity of mNGS in detecting viruses was 60% (95% CI, 27.4 to 86.3%) and the specificity was 86.4% (95% CI%, 64.0 to 96.4%). The PPV and NPV of the mNGS were 66.7% (95% CI, 30.9–91.0%) and 82.6% (95% CI, 60.5–94.3%), respectively (Table 2).

More mixed pathogens were found in immunocompromised patients. A comparable diagnostic accuracy of mNGS and CTs was found for coinfections. The sensitivity of mNGS was higher than of CTs in detecting the mixed pathogens (68.8% vs. 43.8%, ). The specificity of mNGS was 87.5% (95% CI, 60.4–97.8%). The PPV and NPV of the mNGS were 84.6% (95% CI, 53.7–97.3%) and 73.7% 82.6% (95% CI, 60.5–94.3%), respectively.

4. Discussion

This study described the distribution of pathogens in immunocompromised and immunocompetent patients and compared the diagnostic value of mNGS with CTs in the etiology of pneumonia. Moreover, the effectiveness of different pathogenic diagnoses was explored in immunocompromised patients based on mNGS. We have shown that mNGS is more valuable for pathogenic diagnosis, especially in the detection of bacterial and mixed infections in immunocompromised patients.

Although several studies have reported that the distribution of pathogens and the diagnostic performance of mNGS in different patients [15, 17, 25], the comparative study of mNGS and CTs in immunocompromised and immunocompetent patients with different pathogens is lacking and still controversial. Miao et al. showed that mNGS was not superior to routine microbiological methods for detecting bacteria but had better performance than conventional testing for detecting fungi [21]. However, Fang et al. indicated that mNGS was superior to conventional testing in detecting bacteria and viruses but had no advantages in detecting fungal infections [26]. Peng et al. found that the diagnostic performance of comprehensive conventional tests was similar to that of mNGS for all types of pathogens [17]. Lin et al. found mNGS improved the microbial detection rate of pathogens, compared with comprehensive conventional tests [27]. Unfortunately, previous studies did not identify the definition of comprehensive conventional tests and analyse the diagnostic performance of mNGS versus comprehensive conventional tests in immunocompetent and immunocompromised patients. We selected patients who must have had at least 2 or more traditional pathogenic detection results and compared mNGS with CTs in two groups. The sensitivity, specificity, PPV, and NPV of mNGS and CTs were compared, and the advantages and disadvantages of mNGS methods in the detection of various pathogens were found.

Consistent with previous studies, the distribution of pathogens was different in immunocompetent and immunocompromised patients. In immunocompromised patients, Cytomegalovirus, Pneumocystis jirovecii, Klebsiella pneumonia, and Staphylococcus were the most detected pathogens. Compared with immunocompetent patients, more mixed infections were found and bacterial-fungal-viral infections were the most frequent combinations in immunocompromised patients [25]. This may be related to the low immunity of patients, who are more likely to be infected by common and opportunistic pathogens. The study showed that the mNGS method had a higher positive rate than CTs in two groups, which is consistent with previous studies [21, 28]. Furthermore, mNGS had obvious advantages in pathogen detection in immunocompromised than immunocompromised patients (78.1% vs. 57.1%). The kappa values were low (0.055 and 0.347) in two groups, which indicated a lack of consistency. It was due to the diversity of pathogens detected by mNGS.

The strength of our study is that we tried to evaluate the diagnostic performance of mNGS with regard to different types of pathogens and coinfections. We concluded that mNGS had a comparable accuracy rate to that of CTs for the diagnosis of bacterial, viral, and fungal infections and coinfections. However, in immunocompromised patients, mNGS had higher sensitivity than CTs in the detection of bacterial and mixed infections. It could detect many pathogenic bacteria that cannot be detected by CTs. So, mNGS may be used as a routine diagnostic tool for bacterial and mixed infections in immunocompromised patients, although certain disadvantages were pointed out, such as the possibility of the false positive due to the test being too sensitive. Thus, mNGS had no obvious advantages over fungal and viral infections in our study, which was consistent with previous studies [6, 17]. More patients were diagnosed with Pneumocystis jirovecii in immunocompromised patients in our study. Jiang et al. reached the conclusion that mNGS had a sensitivity of 100% in diagnosing Pneumocystis jirovecii pneumonia (PJP), which was remarkably higher than GMS (25.0%) and the serum G test (67.4%) [15]. However, we noticed that the patients had a high sensitivity of CTs (100%) (included G test and GMS) which was similar with mNGS in PJP. Actually, a large sample study is still needed for further exploration. In addition, we explored the diagnostic performance of mNGS in immunocompromised patients with coinfections. mNGS had obvious diagnostic advantages in mixed infections, compared with CTs. We detected mixed infections of bacterial-fungal-viral (Cytomegalovirus and Pneumocystis jirovecii often coexist with other bacteria), which was the most common pathogen combination.

There are some limitations in the current study. Firstly, the study was a retrospective study with small samples. A further prospective study should be carried out to explore the diagnostic performance of mNGS with different types of pathogens. Secondly, we included various types of immunocompromised patients, and there may be a relationship between the differences in their etiological composition and the diagnostic performance of mNGS. Lastly, we did not assess the guiding value of mNGS in the management of immunocompromised versus immunocompetent patients.

5. Conclusion

Overall, the distribution of pathogens was different between immunocompetent and immunocompromised patients. mNGS is a promising alternative or complementary diagnostic method for detecting bacterial and coinfections, especially in immunocompromised patients. It may be an alternative or complementary diagnostic method for the diagnosis of complicated infections in immunocompromised patients.

Data Availability

Data will be made available on request to the corresponding author.

Ethical Approval

This study was approved by the Ethics Committee of Peking University First Hospital (2021KEYAN111).

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This study was funded by the National Key R&D Program of China (2020YFC2005401).

Supplementary Materials

Figure S1. Percentage of patients with coinfections with various pathogens in immunocompromised patients. Figure S2. The comparison of mNGS and CTs for the detection of different pathogens in immunocompromised patients. Table S1. Infection identified by CTs and mNGS. (Supplementary Materials)