About this Journal Submit a Manuscript Table of Contents
Journal of Biomedicine and Biotechnology
Volume 2010 (2010), Article ID 297505, 15 pages
http://dx.doi.org/10.1155/2010/297505
Methodology Report

Vaxign: The First Web-Based Vaccine Design Program for Reverse Vaccinology and Applications for Vaccine Development

1Unit for Laboratory Animal Medicine, University of Michigan Medical School, Ann Arbor, MI 48109, USA
2Department of Microbiology and Immunology, University of Michigan Medical School, Ann Arbor, MI 48109, USA
3Center for Computational Medicine and Biology, University of Michigan Medical School, Ann Arbor, MI 48109, USA

Received 2 November 2009; Accepted 6 May 2010

Academic Editor: Anne S. De Groot

Copyright © 2010 Yongqun He et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Vaxign is the first web-based vaccine design system that predicts vaccine targets based on genome sequences using the strategy of reverse vaccinology. Predicted features in the Vaxign pipeline include protein subcellular location, transmembrane helices, adhesin probability, conservation to human and/or mouse proteins, sequence exclusion from genome(s) of nonpathogenic strain(s), and epitope binding to MHC class I and class II. The precomputed Vaxign database contains prediction of vaccine targets for genomes. Vaxign also performs dynamic vaccine target prediction based on input sequences. To demonstrate the utility of this program, the vaccine candidates against uropathogenic Escherichia coli (UPEC) were predicted using Vaxign and compared with various experimental studies. Our results indicate that Vaxign is an accurate and efficient vaccine design program.

1. Introduction

Reverse vaccinology is an emerging vaccine development approach that starts with the prediction of vaccine targets by bioinformatics analysis of microbial genome sequences [1]. Predicted proteins are selected based on desirable attributes. Normal wet laboratory experiments are conducted in a later stage to test all or selected vaccine targets. Rino Rappuoli, the pioneer of reverse vaccinology [1, 2], first applied this approach to the development of a vaccine against serogroup B Neisseria meningitidis (MenB), the major cause of sepsis and meningitis in children and young adults [2]. In this study, bioinformatic methods were first used to screen the complete genome of a MenB strain MC58 for genes encoding putative surface-exposed or secreted proteins. These proteins were predicted to be antigenic and therefore may represent the most suitable vaccine candidates. In total, 350 novel vaccine candidates were predicted and expressed in Escherichia coli; 28 were found to elicit protective immunity. It took less than 18 months to identify more vaccine candidates in MenB than had been discovered during the past 40 years by conventional methods [2]. Since then, the concept of reverse vaccinology has also successfully been applied to other pathogens, including Bacillus anthracis [3], Porphyromonas gingivalis [4], Chlamydia pneumoniae [5], Streptococcus pneumoniae [6], Helicobacter pylori [7], and Mycobacterium tuberculosis [8]. Compared to a conventional vaccine development approach that starts from the wet laboratory, reverse vaccinology begins with bioinformatics analysis, which dramatically quickens the process of vaccine development.

Since reverse vaccinology was conceived and applied in a test case ten years ago, this technology has progressed dramatically. Subcellular location is still considered as one main criterion for vaccine target prediction. However, more criteria have been added. For example, since it was found that outer membrane proteins containing more than one transmembrane helix were, in general, difficult to clone and purify [2], the number of transmembrane domains for a vaccine target is often considered in bioinformatics filtering. More and more genomes are now available for each pathogenic species. It is now required to examine all completed genomes and predict vaccine targets that are conserved in all genomes. If genomes from non-pathogenic strains of the species are also available, ideal vaccine targets are those that exist in genomes of virulent pathogen strains but are absent from the avirulent strains. To induce strong immunity and avoid autoimmunity, predicted vaccine targets are required not to have sequence similarity to proteins of hosts (e.g., human). Epitope-based vaccines have been demonstrated to induce protection against many infectious diseases [9]. To optimize epitope vaccines, it has become an essential task to predict immune epitopes from protective antigens.

While reverse vaccinology has been used for a decade, this approach is often not accessible to the general laboratory, due to the lack of software programs that are easy to use and implement. Although many individual software programs are available to aid in vaccine target prediction [1017], they are individually developed for different purposes and contain disparate data formats and programming settings. This makes tool and data integration difficult. Successful use of these tools often requires local installation, command line execution, and substantial computational power. Many tools are not optimized for high throughput data processing. NERVE, for example, is a new enhanced reverse vaccinology environment that includes several steps of programs for reverse vaccinology [18]. NERVE aims to help save time and money in vaccine design. However, it also requires software download and database setup. In addition, NERVE does not include precomputed data of vaccine target prediction, which makes the prediction time extensive. In addition, NERVE does not perform MHC class I and II epitope predictions.

Many immunoinformatics epitope mapping tools have been developed during the last three decades [19]. For example, DeLisi and Berzofsky developed the earliest computer-driven algorithm for epitope mapping based on empirical observations of amino acid residue periodicity in T-cell epitopes [20]. The anchor-based MHC binding motifs were used for T-cell epitope identification by many researchers, such as Sette et al. in 1989 [21] and Rotzschke et al. in 1991 [22]. Matrix-based approached for T-cell epitope mapping have been developed by a number of research teams such as Sette et al. [23], Davenport et al. [24], De Groot et al. [25], and Reche et al. [15]. Many databases of MHC-binding peptides, starting from MHCPEP developed by Brusic et al. in 1994 [26] to the currently frequently used IEDB [27], have been developed for use with matrices and neural network-based epitope prediction tools.

Uropathogenic Escherichia coli (UPEC) is the most common cause of community-acquired urinary tract infection (UTI). Over half (53%) of all women (and 14% of men) experience at least one urinary tract infection (UTI), leading to an estimated 6.8 million annual physician visits in the United States alone, 1.3 million emergency room visits, and 246,000 hospitalizations of women with an annual cost of more than $2.4 billion [28]. Although many groups have attempted to develop vaccines against UPEC [2933], no preparations are yet in general use in the United States. Complete and annotated genomic sequences have now been determined for four strains of extraintestinal pathogenic E. coli including CFT073, UTI89, 536, and F11; these UPEC strains were isolated from human cases of cystitis, pyelonephritis, and/or bacteremia. These provide a basis for predicting UPEC vaccine targets using these genome sequences based on reverse vaccinology. Recently, we have also performed several high throughput proteomic and genomic studies including in vivo microarray [34], proteomics of urine-grown bacteria [35], and in vivo induced antigen technology (IVIAT) [36]. We hypothesized that vaccine targets predicted based on genome analysis largely correlate with the results obtained from these high throughput data analyses.

Vaxign (http://www.violinet.org/vaxign/), the first web-based, publically available vaccine design system, was first introduced in the second Vaccine Congress meeting in December 2008 in Boston, MA, USA. Vaxign was demonstrated to successfully predict vaccine targets against different pathogens [37]. Since then, Vaxign has significantly been improved in terms of performance and speed. In this report, we systematically introduce the updated Vaxign prediction system, and describe how Vaxign was used to predict vaccine targets against uropathogenic E. coli (UPEC). Many predicted results, based on genome sequence analyses, were also confirmed by wet-lab testing and other studies based on RNA, protein, and antibody analyses.

2. Methods

2.1. Vaxign Software Components for Vaccine Target Prediction

Vaxign integrates open source tools and internally developed programs with user-friendly web interfaces. Input data for Vaxign execution are amino acid sequences from one protein or whole genomes. This Vaxign pipeline includes the following components (Figure 1).

297505.fig.001
Figure 1: The Vaxign algorithm pipeline.

(1) Prediction of subcellular localization. Vaxign predicts different subcellular locations using optimized PSORTb 2.0 that has a measured overall precision of 96% [10].

(2) Transmembrane domain prediction. The transmembrane helix topology analysis is performed using optimized HMMTOP based on a general hidden Markov model (HMM) decoding algorithm [11]. A profile-based hidden Markov model implemented in PROFtmb is used in Vaxign for the prediction and discrimination of bacterial transmembrane beta barrels [38]. The resulting PROFtmb method reaches an overall four-state (up-, down-strand, periplasmic-,and outer-loop) accuracy as high as 86% [38]. Since the execution of PROTtmb is very time consuming, not all proteins in all genomes in the Vaxign database were preanalyzed for transmembrane beta barrel analysis.

(3) Calculation of adhesin probability. Adhesin probability is predicted using optimized SPAAN [12]. The SPAAN prediction has a sensitivity of 89% and specificity of 100% based on a defined test set [12]. The probability of being an adhesin has a default cut-off of 0.51.

(4) Protein conservation among different genomes. This program identifies conserved sequences among more than one genome. OrthoMCL is applied to calculate the homology between different sequences [13]. The E-value of is set as the default value. An internally developed reciprocal best fit method, based on BLAST, was also developed for result comparison.

(5) Exclusion of sequences present in nonpathogenic strains. OrthoMCL is used to calculate the homology between predicted sequences and all proteins in a specified non-pathogenic strain genome(s) [13].

(6) Comparison of sequence similarity between predicted proteins and host (human and/or mouse) proteome. OrthoMCL is customized for this purpose.

(7) Prediction of MHC class I- and class II-binding epitopes. Vaxign uses an internally developed program Vaxitope to predict MHC class I and class II binding epitopes. Vaxitope is developed based on PSSM (Position Specific Scoring Matrix) motif prediction. The PSSMs for the prediction of peptide binders to MHC class I or II are calculated based on a position-based weighting method using the BLK2PSSM utility included in the BLIMPS package [14]. Data for generating the PSSMs came from known epitope data from the IEDB immune epitope database [27]. The P value for the predicted epitope binding to PSSMs is calculated by the MAST sequence homology search algorithm [39]. A receiver operating characteristic (ROC) curve and the values of the area under the ROC Curve (AUC) were used to calculate the accuracy of the Vaxitope prediction [40]. For the AUC analysis, the epitope data from the IEDB immune epitope database [27] were used. A leave-one-out approach was applied to test if a known epitope can be predicted on the condition that this epitope is excluded in initial generation of PSSMs.

(8) Protein functional analysis: Predicted proteins can be selected and automatically exported to the DAVID bioinformatics resources [41] for functional protein analysis.

2.2. Vaxign Server and Web Implementation

Vaxign is implemented using a three-tier architecture built on two Dell Poweredge 2580 servers which run the Redhat Linux operating system (Redhat Enterprise Linux ES 5). Users can submit database or analysis queries through the web. These queries are then processed using PHP/HTML/SQL (middle-tier, application server based on Apache) against a MySQL (version 5.0) relational database (back-end, database server), or executed in runtime based on the Vaxign algorithm pipeline. The result of each query is then presented to the user in the web browser (Figure 1). Two servers are scheduled to regularly backup each others’ data.

2.3. Application of Vaxign in Prediction of UPEC Vaccine Targets

To predict vaccine targets against uropathogenic E. coli (UPEC) using Vaxign, four UPEC strains with fully sequenced genomes were used: strains CFT073 (RefSeq ID: NC_004431), 536 (NC_008253), UTI89 (NC_007946), and F11 (NZ_AAJU00000000). Microbial genomes and protein sequences were downloaded from NCBI RefSeq genome database [42]. To determine whether predicted antigens exist in UPEC strains but not in non-pathogenic E. coli, the non-pathogenic E. coli K-12 strain MG1655 (RefSeq ID: NC_000913) [43] was used as a control genome.

2.4. Comparison of Different Methods in UPEC Vaccine Target Prediction

The results of UPEC vaccine targets predicted by Vaxign were manually compared with results from our previous studies using microarray [34], proteomics [35], immunoproteomic analysis [36].

2.5. Verification of UPEC Vaccine Targets Predicted by Vaxign

To experimentally verify the predicted data, UPEC proteins were prepared using recombinant cloning technology. For active immunization, CBA/J mice ( for each group) were intranasally immunized with individual proteins combined with cholera toxin. As negative control, cholera toxin alone was also used to vaccinate mice. The vaccinated group were boosted at 7 and 14 days. One week after the final boost, control (naïve: Ctx-treated) and vaccinated mice were transurethrally challenged with CFU E. coli CFT073. After a one-week, the efficacy of protection by individual subunit vaccines was evaluated by measuring the CFU/ml urine and CFU/g bladder or kidney tissue. The vaccine challenge experiments were reported in a recent publication [33].

3. Results

3.1. The Vaxign Algorithm for Vaccine Target Prediction

The workflow of the Vaxign pipeline is shown in Figure 1. The predicted features in Vaxign include protein subcellular location, transmembrane helices, adhesin probability, sequence conservation among pathogen genomes, and sequence similarity to host (human and mouse) proteomes. For those pathogens against which a strong B cell response (for antibody production) is critical, surface-exposed proteins such as secreted proteins and outer membrane proteins (especially adhesins) are ideal targets for vaccine development. For these pathogens, nonsurface proteins such as cytoplasmic or inner membrane proteins, however, may not represent good targets for vaccine development due to lack of close contact with the host cells [1, 2]. However, for the vaccine development against those pathogens where T cell response is critical, subcellular localization is not an issue since a T cell response could be directed to any protein target. It has been reported that 250 out of 600 vaccine candidates from N. meningitidis B failed to be cloned and expressed due to the presence of more than one transmembrane spanning region [2]. Therefore, it might also be prudent to ignore those proteins with multiple transmembrane spanning regions in the first place. The adherence of microbial pathogens to host cells is mediated by adhesins. Adhesins are essential for bacterial colonization and survival and represent possible targets for vaccine development. The conserved vaccine targets among different strains in one pathogen offer protection against these different strains. A vaccine candidate with similar sequence to the host (e.g., human or mouse) is likely to be a poor immunogen due to epitope mimicry, or if an immune response is triggered, cause autoimmunity in the host [4446]. These aspects are considered in the Vaxign prediction pipeline (Figure 1).

During the past decades, many algorithms and software programs have been developed to address individual processes in the Vaxign vaccine design pipeline. Many software programs have been widely tested and validated. To avoid reinventing the wheel, we have incorporated many existing software programs into Vaxign as described in the Section 2. All open source programs (e.g., BLAST) have been customized. The Vaxitope (vaccine epitope prediction) is a new program that is internally developed and will be described later in this paper in more detail. One focus of the Vaxign development was to seamlessly incorporate different programs with different development styles and even program languages into a comprehensive analysis system. To achieve this goal, MySQL relational database was used to replace plain text input files typically used in original programs. In a typical scenario, output data of one program is stored in MySQL, and SQL query scripts are used to retrieve and process the data as input for another program. Each component program except Vaxitope in the Vaxign pipeline has individually been tested and validated in the literature [1013]. The testing of Vaxitope is described below.

The Vaxign database contains precomputed prediction results using 76 genomes from 13 pathogens (Table 1). In total, 191,192 proteins have been precomputed. These data can be queried using the Vaxign web interface. A user can also input protein sequence data for dynamic computation and result output.

tab1
Table 1: Pathogens currently analyzed by Vaxign.
3.2. Vaxitope: Prediction of MHC Class I and Class II Binding Epitopes

Vaxign predicts both MHC class I and class II binding epitopes using an internally developed tool Vaxitope. Vaxitope is based on Position Specific Scoring Matrix (PSSM), a type of scoring matrix used in protein similarity searches in which amino acid substitution scores are given separately for each position in a protein multiple sequence alignment. In PSSM, a Tyr-Trp substitution at position A of an alignment may receive a very different score than the same substitution at position B. In contrast, in position-independent matrices such as the PAM and BLOSUM matrices, the Tyr-Trp substitution receives the same score no matter at what position it occurs. The general strategy of using PSSMs for prediction of MHC Class I and II binding has proven effective in RANKPEP [15].

To evaluate the performance of Vaxitope, a receiver operating characteristic (ROC) curve analysis was generated for prediction of epitopes against 40 MHC class I or II alleles (Table 2). The ROC analysis detects the ability of predictions to classify each predicted epitope peptide into MHC class I or II binding based on its comparison with existing epitope database [40]. Plotting the rates of true-positive predictions (sensitivity) as a function of the rate of false-positive predictions (1-specificity) gives an ROC curve. For example, a ROC curve based on Vaxign analysis was generated using HLA A specific PSSM (Figure 2). HLA A is one of the most studied HLA MHC Class I allele. According to the IEDB immune epitope database [27], 3216 epitopes are known to positively bind to this allele (as positive testing dataset), and 4826 epitopes cannot bind to this allele (as negative testing dataset). The positive HLA A alleles were used to calculate the True Positive Rate (Sensitivity). The negative alleles were used to calculate the False Positive Rate (1-Specificity) (Figure 2). The areas under the ROC curve (AUC) provide a way to measure prediction quality. An AUC of 0.5 represents random predictions, and an AUC of 1.0 indicates perfect predictions [16]. The value of the Area Under the ROC Curve (AUC) for the HLA A analysis using Vaxitope is 0.929. Our analysis of 30 alleles indicates that Vaxitope is a very specific and sensitive method for MHC Class I and II binding epitope prediction (Table 2).

tab2
Table 2: Epitope prediction performance by Vaxitope as measured by AUC values.
297505.fig.002
Figure 2: ROC curve analysis of epitopes binding HLA A .

It is interesting to compare Vaxign and RANKPEP since both methods are based on PSSM. If only AUC values are taken into account, our prediction results are in general better than the results predicted by RANKPEP [15]. However, the results may not be comparable, since the data required to generate PSSMs might be different. Different from RANKPEP, which uses a percentage or top number as the cut off as shown in RANKPEP [15], Vaxitope defines statistical P-values based on a random sequence model that assumes each position in a random sequence is generated according to the average letter frequencies of all sequences in the NCBI peptide non-redundant database [39]. Our studies indicate that the P value of  .05 provides a cutoff with high and balanced sensitivity and specificity (Table 2). Another unique feature in Vaxitope is that it integrates with other vaccine design components in Vaxign. For example, the input sequence of Vaxitope may come from those peptides that are part of an outer membrane protein and exposed outside the bacterial membrane (Figure 3). These protein peptides are predicted by Vaxign and easily available as input data for Vaxitope. Vaxitope also allows genome-wide query on different MHC host species.

297505.fig.003
Figure 3: Vaxign prediction of UPEC vaccine targets. (a) Selection of E. coli CFT073 as a seed genome. Different filter options are applied: only outer membrane proteins, maximum of one transmembrane helix, minimum adhesin probability of.51, having orthologs in other three UPEC genomes but no orthologs in K-12 strain M1655, and no similarity to any human or mouse proteins. (b) In total 22 proteins were predicted to meet selected criteria. (c) Detailed results for a particular protein, for example, NmpC. MHC Class I and II epitope prediction results are also available and can be further filtered. (d) Prediction of α-helices and their possible cellular locations of NmpC. (e) Prediction of -barrels and their possible cellular locations of NmpC.

Traditional reverse vaccinology does not consider prediction of epitopes. With the P value cut off of  .05, 1436 epitopes from E. coli protein Hma for 39 MHC Class I alleles in 4 hosts and 515 epitopes for 23 MHC Class II alleles have been found in 4 hosts—human, mouse, macaque, and chimpanzee. It remains a challenge to rank and optimize the epitopes for vaccine development. Possible solutions to address this challenge are described in the Discussion.

3.3. User-Friendly Vaxign Web Interface

To make Vaxign easy to use, two methods of implementation have been developed. Users can either directly query precomputed prediction results from the Vaxign database, or request Vaxign to dynamically calculate results based on the users’ input sequences. The prediction data from the precomputed Vaxign database can be easily queried using our Vaxign web query interface (Figure 3).

A simple web query interface is available for querying the precomputed Vaxign results from the protein level or genome level (Figure 3). Users are prompted to set up preferred query criteria; the output data are then provided. The query of precomputed Vaxign results is fast. A typical query involved in four genomes and all the steps as shown in our UPEC use case (Figure 3) takes approximately 2–5 seconds.

The other form is dynamic Vaxign analysis, which is similar to the precomputed Vaxign except that a user is prompted to provide information for up to 300 proteins at one time. The protein information may be protein sequences using FASTA format, NCBI protein GI, or RefSeq accession number. Vaxign predicts vaccine targets based on runtime execution. It typically takes 30–60 seconds to execute all the steps in run time for one single protein. Therefore, it would take 150–300 minutes to finish analysis of 300 proteins. Once all steps are finished, the web link of the predicted results will be sent to a registered user through email.

3.4. Vaxign Predicts 22 Outer Membrane Proteins as UPEC Vaccine Targets

The genomes of all four UPEC strains (CFT073, 536, UT189, and F11) for which complete sequence data are available were analyzed by Vaxign (Figure 4). These four genomes contain 4704–5379 genes. Only outer membrane proteins (OMP) are predicted and analyzed. From the total 5379 proteins in UPEC strain CFT073, Vaxign detects 107 outer membrane proteins. Among the 107 proteins, three proteins contain more than one transmembrane helix. Vaxign further predicts 70 proteins from the 107 OMPs in strain CFT073 as possible adhesins or adhesin-like proteins [34]. These predicted adhesins are likely critical for colonization, a major challenge facing UPEC in the urinary tract. While some of these proteins, such as PapC [47], are adhesins, many of these 70 proteins (e.g., Hma, FepA) predicted to be adhesins are not typically considered as adhesins. The roles of these adhesin-like proteins in adhering to host cells require further investigation. None of these 70 proteins shows sequence similarity to any human or mouse proteins. Similar strategy was applied to obtain vaccine targets for the other three UPEC strains (Figure 4).

297505.fig.004
Figure 4: Prediction of UPEC vaccine targets conserved in four sequenced UPEC genomes using Vaxign. Note: Co-ed represents the conserved proteins.

Ortholog analysis was then applied to obtain conserved vaccine targets from four UPEC strains. In total, 85 OMPs were found to be conserved across all four pathogenic UPEC strains (Figure 4). Among these 85 OMPs, two proteins (NP_755264.1, NP_756232.1) are predicted to contain three transmembrane helixes. Multiple transmembrane helixes make it difficult to purify recombinant proteins [48]. Therefore, these two proteins may not be good vaccine targets as whole protein antigens. When adhesin probability is taken into account, 58 out of the 83 proteins have an adhesin probability of .

Functional gene enrichment analysis was performed to classify the roles of these 58 OMPs using the software DAVID (Table 3). Only 48 genes have annotation in DAVID and thus included in the DAVID analysis. Among these 48 genes, significantly enriched function annotations are in the areas of transport activities, TonB-dependent receptor (beta-barrel), Gram-negative porin, iron ion transmembrane transporter activity, and fimbrial biogenesis in outer membrane (Table 3).

tab3
Table 3: Selected function annotations significantly enriched for UPEC vaccine candidates based on DAVID analysis.

Of these 58 outer membrane proteins identified by Vaxign, 36 were further found to be present in the non-pathogenic E. coli K-12 strain MG1655 [43]. K-12 is used to remove those proteins that have been exposed to the host environment (e.g., gut) and may be tolerant by the host [49]. Only 22 proteins have been identified to be unique to the pathogenic UPEC strains (Figure 4).

A table of genes in different categories were further generated based on the Figure 4 and Table 3 and manual curation of literature data (Table 4). Eight E. coli proteins are predicted to contain iron-binding and iron siderophore transporter activity. Ten proteins are associated with a TonB box [50], and thus may play a role in iron acquisition by the bacterium. Another eight proteins are fimbrial biogenesis outer membrane usher proteins. Nine proteins are related to porin and ion transport. Indeed, many proteins in the list participate in transporter activity. Many lipoproteins have also been found. All of these targets would be logical selections. Many hypothetic proteins have been found with no defined functions or annotations.

tab4
Table 4: Conserved UPEC outer membrane proteins predicted by Vaxign.
3.5. Comparison of Vaxign Prediction Results and other Methods

The predicted results based on DNA sequence analysis are compared with data from transcriptomic microarray data [34], mass spectrometry proteomic studies [35, 51], and antigenicity analysis [36]. Out of 85 predicted outer membrane proteins that are conserved among four UPEC strains, 23 proteins have been found upregulated in vivo or in urine at the mRNA and/or protein levels (Table 4). It was found that many proteins with upregulated gene expression belong to iron ion binding proteins and porin family. However, only one protein (FimD) from fimbrial biogenesis outer membrane protein family was shown to be upregulated in DNA microarray analysis (Table 4) [34].

Five out of 14 iron binding proteins (IroN, FepA, FhuA, Hma, and ChuA) discovered by Vaxign have been found to be upregulated in vivo or in urine (Table 4) [3436, 51]. Since iron metabolism is critical for UPEC pathogenesis, these proteins are important vaccine targets. Five proteins from porin family have also been found upregulated in vivo or in urine, including NmpC, OmpC, LamB, OmpF, and FadL (Table 4). Limited study has been performed to investigate the roles of these porin proteins in induction of protective immunity against UPEC infection.

3.6. Verification of Vaxign Predicted Results

Iron binding proteins were chosen for development of UPEC subunit vaccines. These proteins are typically outer membrane -barrel proteins that function as receptors for iron-containing compounds. This group of proteins were predicted by Vaxign (Table 4) and significantly enriched based on gene enrichment analysis (Table 3). The antigen c2482 (renamed Hma for heme acquisition), a heme-binding protein, was first cloned and purified, and used for in vivo mouse testing. It was found that intranasal immunization with Hma generated an antigen-specific humoral response, antigen-specific production of IL-17 and IFN- , and provided significant protection against experimental infection with UPEC strain CFT073 [33].

ChuA was another heme/hemoglobin receptor that was also present in microarray & proteomics studies (Table 4) [34, 35]. Our experimental studies found that recombinant ChuA induced severe sickness in mice. Mice that recovered from the ChuA vaccination were challenged with strain CFT073, but were not protected (data not shown).

IroN has been found to be a protective antigen [49]. However, our study did not find significant protection stimulated by IroN [33]. This protein also exists in E. coli K-12, which may bring a discussion about whether it is needed to use this cutoff.

Two other proteins, IreA (NP_757022.1, c5174) and IutA (NP_755498.1), were also tested based on six independent screens [33]. Both are putative iron-regulated outer membrane virulence proteins. Our studies found that IreA and IutA were able to independently stimulate protective immunity in mouse bladder against challenge with UPEC strain CFT073 [33]. These two proteins were not shown in our final list of vaccine candidates predicted by our Vaxign analysis pipeline because they were filtered out due to their absence in the other three UPEC genomes.

4. Discussion

Vaxign is the first web-based vaccine design software program freely available for the purpose of facilitating reverse vaccinology. Vaxign optimizes the conditions and performance of many public tools and provides new programs in a way optimal for analyzing high throughput data. The seamless integration makes Vaxign a user-friendly environment specific for reverse vaccinology. Our analysis indicates that Vaxign specifically and sensitively predicts known vaccine targets and also provides new vaccine target candidates deserving further wet lab confirmation. Vaxign is expected to become a publically available web-based program for vaccine researchers to efficiently design vaccine targets and develop vaccines using a rationale reverse vaccinology strategy.

To test whether Vaxign is capable of predicting those protective antigens that have been validated based on wet laboratory experiments, we have curated the literature and obtain a list of proteins and used Vaxign to analyze those protective antigens. Vaxign has also been used to predict vaccine targets using other bacteria such as Brucella spp., Neisseria meningitides, and Mycobacterium tuberculosis. Our studies indicated that Vaxign predicted results are consistent with existing reports [37].

We showed in this report that Vaxign can be successfully used for prediction of UPEC vaccine candidates. While UPEC FimH was reported to be a protective antigen [52], it was not included in our list of predicted genes (Table 4). FimH is predicted by Vaxign as an adhesin with an adhesin probability of  .96. This prediction is consistent with current knowledge about this protein [52]. Based on an X-ray structure analysis, FimH is folded into two domains of the all-beta class connected by a short extended linker [53]. FimH was not shown in our final predicted list since its subcellular localization was predicted unknown ( ). If only a high adhesin probability is considered, FimH would be included in our prediction list. This also indicates different Vaxign options selected by a user would change the results. However, we identified another protein in that complex (FimD) (Table 4). Vaxign identified IroN, Hma, and ChuA (Table 4) which were selected as possible protective antigens after lengthy experimental assessment [33]. Our study found that Hma induced protection in mice from transurethral challenge with UPEC. Another independent study indicated that subcutaneous immunization with denatured IroN conferred significant protection against renal, but not bladder, urinary tract infection in a mouse model [54].

While recombinant ChuA induced severe sickness in mice, the immunized mice did not protect against virulent UPEC infection. This sickness was probably due to its Heme-binding activity. The possible release of high levels of inflammatory cytokines and innate immune response might lead to mouse death. It is likely that ChuA contains some immunodominant T cell epitope(s) that activates effector (inflammatory) T cell immunity [46]. In many cases, subdominant epitopes that induce subdominant responses may be important components of an effective immune defence [19]. Immunization with subdominant but optimal epitopes can often induce T cell responses that are more effective than immunodominant epitopes. A more advanced in silico prediction would be able to predict and optimize epitopes for vaccine development.

Our study also indicated that microarray and proteomics gene expression data were complementary to DNA sequence-based analysis in predicting vaccine targets (Table 4). Future directions of further Vaxign development may include addition of other components such as analysis of high throughput transcriptomic (e.g., DNA microarray and superarray) and proteomic data for vaccine target prediction. Predicted vaccine targets can also be analyzed based on gene annotation enrichment to further refine vaccine targets using tools such as DAVID. The gene enrichment results combined with predictions based on DNA sequence analysis as well as mRNA and protein gene expression allowed us to focus on the group of iron binding proteins for experimental testing.

More than 700 microbial genomes have been sequenced and analyzed, which provide a foundation for scientists to develop vaccines using the reverse vaccinology. Reverse vaccinology shortens the period of vaccine target discovery and evaluation to 1-2 years [1]. This new strategy also revolutionizes new vaccine development against pathogens for which the applications of Pasteur’s principles have failed.

The use of proteins is a common approach for genetically engineered vaccine development. However, generating epitope vaccines has many advantages and is currently an active research area. To give the most simplified example, if only one epitope of a large protein is protective, using the peptide epitope would allow the delivery of much higher dose of the key epitope during vaccination. Therefore, prediction of a successful epitope would increase efficacy for the vaccine.

Our studies found that Vaxitope is a sensitive and specific program for predicting immune epitopes that provide good candidates for epitope vaccine development. We are in the processing of designing and evaluating epitope-based UPEC vaccines using Vaxign. We will first target to predict epitopes from antigens (e.g., Hma) that have proven able to induce protective immunity.

It often occurs that many epitopes can be predicted from one specific protein. It is often challenging to rank predicted epitopes for vaccine testing. The epitope ranking can also be used to rank proteins. Many programs, such as EpiAssembler by EpiVax [55], allow epitope content ranking. It is known that the best T cell epitopes tend to contain “clusters” of MHC binding motifs, and the clustering is highly correlated with the immunogenicity [46]. Therefore, it is more effective to design a peptide(s) containing clustered epitopes for induction of better immunogenicity in rational vaccine development. Promiscuous epitopes are those MHC ligands or T-cell epitopes that are recognized in the context of more than one MHC molecule and recognized by more than one T-cell clone. Many software programs, such as TEPITOPE [56], enable the computational identification of promiscuous MHC ligands. The prediction of promiscuous epitopes is also an important feature for epitope-based vaccine design.

It is often that a vaccine candidate that is effective in a mouse model is not effective in human. If the epitopes are designed for human use, the mice used for testing the epitope vaccine usually need to be transgenic. Generating HLA transgenic mice is costly and time consuming. It is possible, however, to design epitopes that are effective for both mouse and human. For example, it was reported that an epitope in human immunodeficiency virus 1 reverse transcriptase was recognized by both mouse and human cytotoxic T lymphocytes [57]. Prediction and screening of such epitopes would simplify our testing of human vaccine candidates in the mouse model.

The molecular mimicry or the cross-reactivity between self epitopes and pathogen epitopes has been found a common reason for many pathogen-induced autoimmune diseases [46]. Many pathogens, such as Klebsiella pneumoniae, Proteus mirabilis, human coronavirus, and Lyme disease spirochete Borrelia burgdorferi carry antigens which cross-react with human antigens [44, 46]. For example, the oligopeptide QTDRED is common to both K. pneumoniae and HLA-B27 nitrogenase reductase enzyme. This sequence similarity appears to cause ankylosing spondyltis. Proteus mirabilis hemolysin contains a molecular mimicry sequence ESRRAL that has the same shape and charge distribution as the rheumatoid arthritis susceptibility sequence EQRRAA. Antibody levels against P. mirabilis hemolysin and a synthetic peptide ESRRAL were significantly higher in rheumatoid arthritis patients [44]. To avoid the autoimmunity, it is important to eliminate the epitopes that are conserved. Currently Vaxign provides a genome-wide sequence similarity analysis at protein levels. Many programs, such as Conservatrix [19] and IEDB Sequence Mapping tool (http://tools.immuneepitope.org/esm/esmhelp.jsp?tab=help), have been developed to map epitope sequences. We plan to develop such epitope sequence mapping tool in Vaxign in the future.

Vaxign is part of VIOLIN, a web-based vaccine database and analysis resource [58]. The predicted vaccine targets from Vaxign will also integrate with those manually annotated vaccine data available in VIOLIN. An literature mining program based on the Vaccine Ontology (http://www.violinet.org/vaccineontology) is also being developed to facilitate automated literature data processing and inference for the purpose of retrieving valuable data for rational vaccine design.

Acknowledgments

This paper was supported by a pilot research Grant to YH and HM at the Center for Computational Medicine and Bioinformatics (CCMB) at the University of Michigan Medical School, Michigan, USA, and Public Health Service grants AI43363 and AI081062 from the National Institutes of Health.

References

  1. R. Rappuoli, “Reverse vaccinology,” Current Opinion in Microbiology, vol. 3, no. 5, pp. 445–450, 2000. View at Publisher · View at Google Scholar · View at Scopus
  2. M. Pizza, V. Scarlato, V. Masignani, et al., “Identification of vaccine candidates against serogroup B meningococcus by whole-genome sequencing,” Science, vol. 287, no. 5459, pp. 1816–1820, 2000. View at Publisher · View at Google Scholar · View at Scopus
  3. N. Ariel, A. Zvi, H. Grosfeld et al., “Search for potential vaccine candidate open reading frames in the Bacillus anthracis virulence plasmid pXO1: in silico and in vitro screening,” Infection and Immunity, vol. 70, no. 12, pp. 6817–6827, 2002. View at Publisher · View at Google Scholar · View at Scopus
  4. B. C. Ross, L. Czajkowski, D. Hocking et al., “Identification of vaccine candidate antigens from a genomic analysis of Porphyromonas gingivalis,” Vaccine, vol. 19, no. 30, pp. 4135–4142, 2001. View at Publisher · View at Google Scholar · View at Scopus
  5. S. Montigiani, F. Falugi, M. Scarselli et al., “Genomic approach for analysis of surface proteins in Chlamydia pneumoniae,” Infection and Immunity, vol. 70, no. 1, pp. 368–379, 2002. View at Publisher · View at Google Scholar · View at Scopus
  6. T. M. Wizemann, J. H. Heinrichs, J. E. Adamou et al., “Use of a whole genome approach to identify vaccine molecules affording protection against Streptococcus pneumoniae infection,” Infection and Immunity, vol. 69, no. 3, pp. 1593–1598, 2001. View at Publisher · View at Google Scholar · View at Scopus
  7. D. N. Chakravarti, M. J. Fiske, L. D. Fletcher, and R. J. Zagursky, “Application of genomics and proteomics for identification of bacterial gene products as potential vaccine candidates,” Vaccine, vol. 19, no. 6, pp. 601–612, 2000. View at Publisher · View at Google Scholar · View at Scopus
  8. J. C. Betts, “Transcriptomics and proteomics: tools for the identification of novel drug targets and vaccine candidates for tuberculosis,” IUBMB Life, vol. 53, no. 4-5, pp. 239–242, 2002. View at Publisher · View at Google Scholar · View at Scopus
  9. A. S. De Groot, “Immunomics: discovering new targets for vaccines and therapeutics,” Drug Discovery Today, vol. 11, no. 5-6, pp. 203–209, 2006. View at Publisher · View at Google Scholar · View at Scopus
  10. J. L. Gardy, M. R. Laird, F. Chen et al., “PSORTb v.2.0: expanded prediction of bacterial protein subcellular localization and insights gained from comparative proteome analysis,” Bioinformatics, vol. 21, no. 5, pp. 617–623, 2005. View at Publisher · View at Google Scholar · View at Scopus
  11. L. Käll, A. Krogh, and E. L. Sonnhammer, “Advantages of combined transmembrane topology and signal peptide prediction—the Phobius web server,” Nucleic Acids Research, vol. 35, pp. W429–W432, 2007. View at Publisher · View at Google Scholar · View at Scopus
  12. G. Sachdeva, K. Kumar, P. Jain, and S. Ramachandran, “SPAAN: a software program for prediction of adhesins and adhesin-like proteins using neural networks,” Bioinformatics, vol. 21, no. 4, pp. 483–491, 2005. View at Publisher · View at Google Scholar · View at Scopus
  13. L. Li, C. J. Stoeckert Jr., and D. S. Roos, “OrthoMCL: identification of ortholog groups for eukaryotic genomes,” Genome Research, vol. 13, no. 9, pp. 2178–2189, 2003. View at Publisher · View at Google Scholar · View at Scopus
  14. S. Henikoff, J. G. Henikoff, and S. Pietrokovski, “Blocks+: a non-redundant database of protein alignment blocks derived from multiple compilations,” Bioinformatics, vol. 15, no. 6, pp. 471–479, 1999. View at Publisher · View at Google Scholar · View at Scopus
  15. P. A. Reche, J.-P. Glutting, H. Zhang, and E. L. Reinherz, “Enhancement to the RANKPEP resource for the prediction of peptide binding to MHC molecules using profiles,” Immunogenetics, vol. 56, no. 6, pp. 405–419, 2004. View at Publisher · View at Google Scholar · View at Scopus
  16. B. Peters, H. H. Bui, S. Frankild et al., “A community resource benchmarking predictions of peptide binding to MHC-I molecules,” PLoS Computational Biology, vol. 2, no. 6 , article e65, 2006. View at Publisher · View at Google Scholar · View at Scopus
  17. H.-G. Rammensee, J. Bachmann, N. P. N. Emmerich, O. A. Bachor, and S. Stevanović, “SYFPEITHI: database for MHC ligands and peptide motifs,” Immunogenetics, vol. 50, no. 3-4, pp. 213–219, 1999. View at Scopus
  18. S. Vivona, F. Bernante, and F. Filippini, “NERVE: new enhanced reverse vaccinology environment,” BMC Biotechnology, vol. 6, article 35, 2006. View at Publisher · View at Google Scholar · View at Scopus
  19. A. S. De Groot, H. Sbai, C. S. Aubin, J. McMurry, and W. Martin, “Immuno-informatics: mining genomes for vaccine components,” Immunology and Cell Biology, vol. 80, no. 3, pp. 255–269, 2002. View at Publisher · View at Google Scholar · View at Scopus
  20. C. DeLisi and J. A. Berzofsky, “T-cell antigenic sites tend to be amphipathic structures,” Proceedings of the National Academy of Sciences of the United States of America, vol. 82, no. 20, pp. 7048–7052, 1985. View at Scopus
  21. A. Sette, S. Buus, E. Appella et al., “Prediction of major histocompatibility complex binding regions of protein antigens by sequence pattern analysis,” Proceedings of the National Academy of Sciences of the United States of America, vol. 86, no. 9, pp. 3296–3300, 1989. View at Scopus
  22. O. Rotzschke, K. Falk, S. Stevanovic, G. Jung, P. Walden, and H.-G. Rammensee, “Exact prediction of a natural T cell epitope,” European Journal of Immunology, vol. 21, no. 11, pp. 2891–2894, 1991. View at Scopus
  23. A. Sette, J. Sidney, C. Oseroff et al., “HLA DR4w4-binding motifs illustrate the biochemical basis of degeneracy and specificity in peptide-DR interactions,” Journal of Immunology, vol. 151, no. 6, pp. 3163–3170, 1993. View at Scopus
  24. M. P. Davenport, I. A. P. H. Shon, and A. V. S. Hill, “An empirical method for the prediction of T-cell epitopes,” Immunogenetics, vol. 42, no. 5, pp. 392–397, 1995. View at Scopus
  25. A. S. De Groot, B. M. Jesdale, E. Szu, J. R. Schafer, R. M. Chicz, and G. Deocampo, “An interactive web site providing major histocompatibility ligand predictions: application to HIV research,” AIDS Research and Human Retroviruses, vol. 13, no. 7, pp. 529–531, 1997. View at Scopus
  26. V. Brusic, G. Rudy, and L. C. Harrison, “MHCPEP: a database of MHC-binding peptides,” Nucleic Acids Research, vol. 22, no. 17, pp. 3663–3665, 1994. View at Scopus
  27. B. Peters, J. Sidney, P. Bourne et al., “The immune epitope database and analysis resource: from vision to blueprint,” PLoS Biology, vol. 3, no. 3, article e91, pp. 379–381, 2005. View at Publisher · View at Google Scholar · View at Scopus
  28. M. S. Litwin, C. S. Saigal, E. M. Yano et al., “Urologic diseases in America project: analytical methods and principal findings,” Journal of Urology, vol. 173, no. 3, pp. 933–937, 2005. View at Publisher · View at Google Scholar · View at Scopus
  29. I. Connell, W. Agace, P. Klemm, M. Schembri, S. Mårild, and C. Svanborg, “Type 1 fimbrial expression enhances Escherichia coli virulence for the urinary tract,” Proceedings of the National Academy of Sciences of the United States of America, vol. 93, no. 18, pp. 9827–9832, 1996. View at Publisher · View at Google Scholar · View at Scopus
  30. S. Langermann, R. Möllby, J. E. Burlein et al., “Vaccination with FimH adhesin protects cynomolgus monkeys from colonization and infection by uropathogenic Escherichia coli,” Journal of Infectious Diseases, vol. 181, no. 2, pp. 774–778, 2000. View at Publisher · View at Google Scholar · View at Scopus
  31. D. T. Uehling, W. J. Hopkins, J. E. Elkahwaji, D. M. Schmidt, and G. E. Leverson, “Phase 2 clinical trial of a vaginal mucosal vaccine for urinary tract infections,” Journal of Urology, vol. 170, no. 3, pp. 867–869, 2003. View at Publisher · View at Google Scholar · View at Scopus
  32. V. Kumar, N. K. Ganguly, K. Joshi et al., “Protective efficacy and immunogenicity of Escherichia coli K13 diphtheria toxoid conjugate against experimental ascending pyelonephritis,” Medical Microbiology and Immunology, vol. 194, no. 4, pp. 211–217, 2005. View at Publisher · View at Google Scholar · View at Scopus
  33. C. J. Alteri, E. C. Hagan, K. E. Sivick, S. N. Smith, and H. L. T. Mobley, “Mucosal immunization with iron receptor antigens protects against urinary tract infection,” PLoS Pathogens, vol. 5, no. 9, Article ID e1000586, 2009. View at Publisher · View at Google Scholar · View at Scopus
  34. J. A. Snyder, B. J. Haugen, E. L. Buckles et al., “Transcriptome of uropathogenic Escherichia coli during urinary tract infection,” Infection and Immunity, vol. 72, no. 11, pp. 6373–6381, 2004. View at Publisher · View at Google Scholar · View at Scopus
  35. C. J. Alteri and H. L. T. Mobley, “Quantitative profile of the uropathogenic Escherichia coli outer membrane proteome during growth in human urine,” Infection and Immunity, vol. 75, no. 6, pp. 2679–2688, 2007. View at Publisher · View at Google Scholar · View at Scopus
  36. E. C. Hagan and H. L. T. Mobley, “Uropathogenic Escherichia coli outer membrane antigens expressed during urinary tract infection,” Infection and Immunity, vol. 75, no. 8, pp. 3941–3949, 2007. View at Publisher · View at Google Scholar · View at Scopus
  37. Z. Xiang and Y. He, “Vaxign: a web-based vaccine target design program for reverse vaccinology,” Procedia in Vaccinology, vol. 1, no. 1, pp. 23–29, 2009. View at Publisher · View at Google Scholar · View at Scopus
  38. H. R. Bigelow, D. S. Petrey, J. Liu, D. Przybylski, and B. Rost, “Predicting transmembrane beta-barrels in proteomes,” Nucleic Acids Research, vol. 32, no. 8, pp. 2566–2577, 2004. View at Publisher · View at Google Scholar · View at Scopus
  39. T. L. Bailey and M. Gribskov, “Combining evidence using p-values: application to sequence homology searches,” Bioinformatics, vol. 14, no. 1, pp. 48–54, 1998. View at Scopus
  40. J. A. Swets, “Measuring the accuracy of diagnostic systems,” Science, vol. 240, no. 4857, pp. 1285–1293, 1988. View at Scopus
  41. D. W. Huang, B. T. Sherman, and R. A. Lempicki, “Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources,” Nature Protocols, vol. 4, no. 1, pp. 44–57, 2009. View at Publisher · View at Google Scholar · View at Scopus
  42. K. D. Pruitt, T. Tatusova, and D. R. Maglott, “NCBI Reference Sequence (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins,” Nucleic Acids Research, vol. 33, pp. D501–D504, 2005. View at Publisher · View at Google Scholar · View at Scopus
  43. F. R. Blattner, G. Plunkett III, C. A. Bloch et al., “The complete genome sequence of Escherichia coli K-12,” Science, vol. 277, no. 5331, pp. 1453–1462, 1997. View at Publisher · View at Google Scholar · View at Scopus
  44. C. Wilson, H. Tiwana, and A. Ebringer, “Molecular mimicry between HLA-DR alleles associated with rheumatoid arthritis and Proteus mirabilis as the aetiological basis for autoimmunity,” Microbes and Infection, vol. 2, no. 12, pp. 1489–1496, 2000. View at Publisher · View at Google Scholar · View at Scopus
  45. I. Nachamkin, B. M. Allos, and T. Ho, “Campylobacter species and Guillain-Barre syndrome,” Clinical Microbiology Reviews, vol. 11, no. 3, pp. 555–567, 1998. View at Scopus
  46. C. A. Weber, P. J. Mehta, M. Ardito, L. Moise, B. Martin, and A. S. De Groot, “T cell epitope: friend or foe? Immunogenicity of biologics in context,” Advanced Drug Delivery Reviews, vol. 61, no. 11, pp. 965–976, 2009. View at Publisher · View at Google Scholar · View at Scopus
  47. P. Naves, G. del Prado, L. Huelves et al., “Correlation between virulence factors and in vitro biofilm formation by Escherichia coli strains,” Microbial Pathogenesis, vol. 45, no. 2, pp. 86–91, 2008. View at Publisher · View at Google Scholar · View at Scopus
  48. D. Serruto, R. Rappuoli, and M. Pizza, “Meningococcus B: from genome to vaccine,” in Genomics, Proteomics and Vaccines, G. Grandi, Ed., pp. 185–201, John Wiley & Sons, 2004.
  49. L. Durant, A. Metais, C. Soulama-Mouze, J.-M. Genevard, X. Nassif, and S. Escaich, “Identification of candidates for a subunit vaccine against extraintestinal pathogenic Escherichia coli,” Infection and Immunity, vol. 75, no. 4, pp. 1916–1925, 2007. View at Publisher · View at Google Scholar · View at Scopus
  50. A. G. Torres, P. Redford, R. A. Welch, and S. M. Payne, “TonB-dependent systems of uropathogenic Escherichia coli: aerobactin and heme transport and TonB are required for virulence in the mouse,” Infection and Immunity, vol. 69, no. 10, pp. 6179–6185, 2001. View at Publisher · View at Google Scholar · View at Scopus
  51. M. S. Walters and H. L. T. Mobley, “Identification of uropathogenic Escherichia coli surface proteins by shotgun proteomics,” Journal of Microbiological Methods, vol. 78, no. 2, pp. 131–135, 2009. View at Publisher · View at Google Scholar · View at Scopus
  52. S. Langermann, S. Palaszynski, M. Barnhart et al., “Prevention of mucosal Escherichia coli infection by FimH-adhesin-based systemic vaccination,” Science, vol. 276, no. 5312, pp. 607–611, 1997. View at Publisher · View at Google Scholar · View at Scopus
  53. D. Choudhury, A. Thompson, V. Stojanoff et al., “X-ray structure of the FimC-FimH chaperone-adhesin complex from uropathogenic Escherichia coli,” Science, vol. 285, no. 5430, pp. 1061–1066, 1999. View at Publisher · View at Google Scholar · View at Scopus
  54. T. A. Russo, C. D. McFadden, U. B. Carlino-MacDonald, J. M. Beanan, R. Olson, and G. E. Wilding, “The Siderophore receptor IroN of extraintestinal pathogenic Escherichia coli is a potential vaccine candidate,” Infection and Immunity, vol. 71, no. 12, pp. 7164–7169, 2003. View at Publisher · View at Google Scholar · View at Scopus
  55. A. S. De Groot, L. Marcon, E. A. Bishop et al., “HIV vaccine development by computer assisted design: the GAIA vaccine,” Vaccine, vol. 23, no. 17-18, pp. 2136–2148, 2005. View at Publisher · View at Google Scholar · View at Scopus
  56. T. Sturniolo, E. Bono, J. Ding et al., “Generation of tissue-specific and promiscuous HLA ligand databases using DNA microarrays and virtual HLA class II matrices,” Nature Biotechnology, vol. 17, no. 6, pp. 555–561, 1999. View at Publisher · View at Google Scholar · View at Scopus
  57. A. Hosmalin, M. Clerici, R. Houghten et al., “An epitope in human immunodeficiency virus 1 reverse transcriptase recognized by both mouse and human cytotoxic T lymphocytes,” Proceedings of the National Academy of Sciences of the United States of America, vol. 87, no. 6, pp. 2344–2348, 1990. View at Scopus
  58. Z. Xiang, T. Todd, K. P. Ku et al., “VIOLIN: vaccine investigation and online information network,” Nucleic Acids Research, vol. 36, no. 1, pp. D923–D928, 2008. View at Publisher · View at Google Scholar · View at Scopus