The FAST-AIMS Clinical Mass Spectrometry Analysis System

Fananapazir, Nafeh; Statnikov, Alexander; Aliferis, Constantin F.

doi:https://doi.org/10.1155/2009/598241

Advances in Bioinformatics

On this page

Abstract Background Discussion Conclusions Acknowledgments References Copyright Related Articles

Resource Review | Open Access

Volume 2009 | Article ID 598241 | https://doi.org/10.1155/2009/598241

The FAST-AIMS Clinical Mass Spectrometry Analysis System

Nafeh Fananapazir,^1,2Alexander Statnikov,^1,3and Constantin F. Aliferis^1,3

Academic Editor: Zoran Obradovic

Received16 Jan 2009

Accepted11 May 2009

Published09 Jul 2009

Abstract

Within clinical proteomics, mass spectrometry analysis of biological samples is emerging as an important high-throughput technology, capable of producing powerful diagnostic and prognostic models and identifying important disease biomarkers. As interest in this area grows, and the number of such proteomics datasets continues to increase, the need has developed for efficient, comprehensive, reproducible methods of mass spectrometry data analysis by both experts and nonexperts. We have designed and implemented a stand-alone software system, FAST-AIMS, which seeks to meet this need through automation of data preprocessing, feature selection, classification model generation, and performance estimation. FAST-AIMS is an efficient and user-friendly stand-alone software for predictive analysis of mass spectrometry data. The present resource review paper will describe the features and use of the FAST-AIMS system. The system is freely available for download for noncommercial use.

1. Background

Mass spectrometry is a widely used analytical technique capable of discriminating proteins and their postdigestion peptide products on the basis of mass and charge. Within the last several years, researchers have explored the use of mass spectrometry for clinical applications in the broad areas of early cancer detection, clinical diagnosis, and clinical outcome prediction. Published reports indicate remarkable potential for this technology to diagnose disease and predict its outcome with minimally invasive testing procedures, low cost, and—in some cases—with unprecedented accuracy. It is expected that mass spectrometry together with other high-throughput technologies will lead the way to personalized medicine in the near future [1–4].

The analysis of high-throughput data such as gene expression microarray has involved a number of statistical challenges, the most notable of which include large number of predictor variables and small sample sizes of typical datasets, high information redundancy, limited reproducibility, and multiple sources of noise in the data [5–7]. The analysis of mass spectrometry data introduces further analytic challenges, requiring additional preprocessing steps such as baseline correction of spectra, detection of peaks corresponding to proteins and their peptide products, normalization of the intensity values of these peaks, alignment or calibration of peaks across spectra, and superimposition of intensity values corresponding to the same mass-to-charge values [4, 7–11]. Furthermore, in typical mass spectrometry analysis, proteins are unknown a priori and identified by mass-to-charge ratios (as opposed to the use of known features in microarray analysis); hence, data modelling tends to be heavily, if not exclusively, guided by the data and not by prior biological knowledge [12].

Contrary to microarray data analysis that is nowadays facilitated by a multitude of software systems for assisting both experts and inexperienced analysts [13], no such system currently exists for mass spectrometry data that will automatically enable a statistically naïve user to (i) create, from start to finish, diagnostic/outcome prediction models, (ii) estimate their predictive performance in future applications, and (iii) select protein markers. Out of existing systems for analysis of mass spectrometry data, a commercial platform ProTS Marker by Biodesix (http://www.biodesix.com/) allows to manually perform the tasks mentioned above, however, it requires significant expertise of the user in analysis of proteomics data. Therefore, there is a strong need for systems that will allow both high-quality first-pass analyses of mass spectrometry data as well as enhancing work of the data analyst.

In the present report, we describe a software system FAST-AIMS (Fully Automated Software Tool for Artificial Intelligence in Mass Spectrometry) which aims at providing this functionality. In addition, given the current lack of protocol standardization for such proteomic data analysis, FAST-AIMS offers an intuitive, stepwise sequence of analysis in aid of developing such standardization. The system is a stand-alone application that runs on a Windows computer and can work with mass spectrometry data generated by different instruments, for example, MALDI, SELDI, LC-MS/MS, and so forth.

2. System Description

The FAST-AIMS system consists of a command-line executable (implemented in Matlab and C) and a wizard-like graphic user interface (implemented in Borland Delphi) that calls the above executable with different parameters. Novice users should utilize a wizard-like interface, while more experienced analysts may benefit from command-line interface for the batch analyses. FAST-AIMS runs on a Windows computer and requires neither Matlab nor other software to be installed. The need for Maltab is circumvented by using Matlab Compiler that translated all relevant Matlab code into C.

FAST-AIMS possesses an intuitive wizard-like interface (Figure 1) with defaults provided so that users need not be familiar with all steps of data analysis. Given a mass spectrometry dataset as input, FAST-AIMS can automatically perform one of the following tasks: (a) generate a classification model by optimizing the parameters of analysis algorithms to ensure its optimal performance; (b) obtain an unbiased estimate of the future classification performance of the optimized model; (c) generate a model and estimate classification performance in tandem; (d) apply an existing model to a new set of samples. In the process, the system also offers the option of identifying biomarkers/features that capture the classification tasks of interest and can be used to explore the underlying biological mechanisms. All FAST-AIMS functions follow the nested N-fold cross-validation design that allows optimization of predictive model parameters while providing an unbiased classification performance estimate [13, 14]. Below, we outline the main steps in the analysis as performed by FAST-AIMS.(1)An opening window asks whether the user wishes to start a new analysis or load a previously saved analysis. In starting a new analysis, the user first selects the location of a mass spectrometry data file. The system recognizes space delimited text data files, each row of which corresponds to the intensity values of a sample and the first column of which corresponds to the response/outcome of each sample. The user can optionally specify the location of the text file with M/Z values arranged in a column. The latter file is used for preprocessing of mass spectrometry data and for generation of the analysis report.(2)The user is then asked to choose from one of the four analysis tasks outlined above.(3)Next, the user selects cross-validation design: N-fold cross-validation or leave-one-out cross-validation.(4)Then the user is asked to select whether baseline subtraction and peak detection [15] and/or peak alignment [16] should be performed.(5)The user specifies a normalization sequence to be applied to the data.(6)The classifier and its parameters are selected by the user. The system uses support-vector machine (SVM) classification algorithms [17] because of their high performance in published analyses of mass spectrometry data and other types of high-throughput data, most notably gene expression arrays in which SVMs outperformed all major pattern recognition algorithms [18, 19].(7)Feature/variable selection algorithms (and their parameters) are selected by the user. The algorithms include: using all features in the data, HITON-PC [20], and SVM weight-based feature selection [21].(8)The user selects a performance estimation metric: either area under ROC curve [22], accuracy, or an entropy-based metric relative classifier information (RCI) [23].(9)A log file destination is specified by the user.(10)A report file destination is specified by the user.(11)The user clicks “Run”. If the task involves generation of classification model and/or performance estimation, the system considers each permutation of the classifier and feature selection algorithm parameters.

Some steps can be performed on each spectrum independently (e.g., peak detection, baseline subtraction, and some normalization methods). All steps that require consideration of multiple spectra (e.g., peak alignment, classification, and feature selection) are performed on each training set of the data to ensure unbiased estimates of the classification performance.

3. Discussion

In our prior work [24], we have evaluated an early prototype version of the FAST-AIMS system using an SELDI mass spectrometry prostate cancer dataset with 162 spectra. The evaluation revealed that the system achieves classification performance comparable to the human expert statistician and superior to the previously published analysis in literature. It took users on average 30 minutes to familiarize with functionality of the system and 19 hours to build the final model, while an expert statistician spent 7 hours for this task. Application of the model to new samples took less than 5 minutes. In general, depending on the dataset characteristics and selected data analysis options, it can take FAST-AIMS from 5 minutes to several days to analyze a dataset (i.e., build the final model). However, a basic first-pass analysis can be conducted within 2–3 hours for a dataset with 200 samples and 60.000 features. Compared to the early prototype version of FAST-AIMS used in [24], the current system has additional functionality (e.g., more performance estimation metrics, ability to output report in HTML file, automatically updated project summary and estimation of complexity of the analysis, built-in help system) and stable software code ready for the public release. Furthermore, the present report provides FAST-AIMS to the community for the first time.

The FAST-AIMS system is designed for mass spectrometry data analysis and inherits challenges of using that technology. For example, given a mass spectrometry dataset a system identifies biomarkers/features that correspond to anonymous peak intensities and may have little significance for the clinical practice [25, 26]. Any potentially interesting peak would have to be examined using an MS/MS system and the findings have to be confirmed by a quantitative proteomics approach [27, 28]. However, we emphasize that FAST-AIMS can be universally applied to various MS and tandem MS measurement technologies and does not require use of specific proteomic platforms such as SELDI or MALDI.

Finally, we believe that recent efforts of the cancer Biomedical Informatics Grid (caBIG) would allow improving the future versions of the FAST-AIMS system. For example, FAST-AIMS can incorporate proteomics related data standards such as mzData (for capturing peak list information) and mzXML (for storage and exchange of mass spectroscopy data) which would make the system more interoperable and would allow obtaining data directly from the proteomics instruments.

4. Conclusions

In this report, we have presented a software system FAST-AIMS for automated predictive analysis of mass spectrometry data. FAST-AIMS is a stand-alone Windows application with an intuitive wizard-like interface that guides the user through different steps of data analysis. The system is freely available for download for noncommercial use from http://www.dsl-lab.org/FAST-AIMS/.

Authors' Contributions
All authors conceived and designed the software. NF and AS implemented the software. NF and AS drafted the paper. All authors read, revised, and approved the final manuscript.

Acknowledgments

The work was in part supported by Grant 2R56LM007948-04A1. NF was supported by the National Library of Medicine Grant T15 LM07450-01.

References

J. R. Yates III, “Mass spectrometry from genomics to proteomics,” Trends in Genetics, vol. 16, no. 1, pp. 5–8, 2000.
View at: Publisher Site | Google Scholar
E. P. Diamandis, “Mass spectrometry as a diagnostic and a cancer biomarker discovery tool: opportunities and potential limitations,” Molecular and Cellular Proteomics, vol. 3, no. 4, pp. 367–378, 2004.
View at: Publisher Site | Google Scholar
L. A. Liotta, E. C. Kohn, and E. F. Petricoin, “Clinical proteomics: personalized molecular medicine,” Journal of the American Medical Association, vol. 286, no. 18, pp. 2211–2214, 2001.
View at: Google Scholar
D. C. Liebler, Proteomics in Cancer Research, Wiley-Liss, Nashville, Tenn, USA, 2005.
J. Quackenbush, “Computational analysis of microarray data,” Nature Reviews Genetics, vol. 2, no. 6, pp. 418–427, 2001.
View at: Publisher Site | Google Scholar
D. P. Berrar, W. Dubitzky, and M. Granzow, A Practical Approach to Microarray Data Analysis, Kluwer Academic Publishers, Boston, Mass, USA, 2003.
F. Azuaje and J. Dopazo, Data Analysis and Visualization in Genomics and Proteomics, John Wiley & Sons, Hoboken, NJ, USA, 2005.
K. R. Coombes, S. Tsavachidis, J. S. Morris, K. A. Baggerly, M.-C. Hung, and H. M. Kuerer, “Improved peak detection and quantification of mass spectrometry data acquired from surface-enhanced laser desorption and ionization by denoising spectra with the undecimated discrete wavelet transform,” Proteomics, vol. 5, no. 16, pp. 4107–4117, 2005.
View at: Publisher Site | Google Scholar
K. A. Baggerly, J. S. Morris, and K. R. Coombes, “Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments,” Bioinformatics, vol. 20, no. 5, pp. 777–785, 2004.
View at: Publisher Site | Google Scholar
B. Domon and R. Aebersold, “Challenges and opportunities in proteomics data analysis,” Molecular and Cellular Proteomics, vol. 5, no. 10, pp. 1921–1926, 2006.
View at: Publisher Site | Google Scholar
R. L. Somorjai, B. Dolenko, and R. Baumgartner, “Class prediction and discovery using gene microarray and proteomics mass spectroscopy data: curses, caveats, cautions,” Bioinformatics, vol. 19, no. 12, pp. 1484–1491, 2003.
View at: Publisher Site | Google Scholar
J. Rappsilber, M. Moniatte, M. L. Nielsen, A. V. Podtelejnikov, and M. Mann, “Experiences and perspectives of MALDI MS and MS/MS in proteomic research,” International Journal of Mass Spectrometry, vol. 226, no. 1, pp. 223–237, 2003.
View at: Publisher Site | Google Scholar
A. Statnikov, I. Tsamardinos, Y. Dosbayev, and C. F. Aliferis, “GEMS: a system for automated cancer diagnosis and biomarker discovery from microarray gene expression data,” International Journal of Medical Informatics, vol. 74, no. 7-8, pp. 491–503, 2005.
View at: Publisher Site | Google Scholar
T. Scheffer, Error estimation and model selection, Ph.D. thesis, School of Computer Science, Technischen Universität Berlin, 1999.
K. R. Coombes, H. A. Fritsche Jr., C. Clarke et al., “Quality control and peak finding for proteomics data collected from nipple aspirate fluid by surface-enhanced laser desorption and ionization,” Clinical Chemistry, vol. 49, no. 10, pp. 1615–1623, 2003.
View at: Publisher Site | Google Scholar
Y. Yasui, D. McLerran, B.-L. Adam, M. Winget, M. Thornquist, and Z. Feng, “An automated peak identification/calibration procedure for high-dimensional protein measures from mass spectrometers,” Journal of Biomedicine and Biotechnology, vol. 4, pp. 242–248, 2003.
View at: Publisher Site | Google Scholar
B. E. Boser, I. M. Guyon, and V. N. Vapnik, “A training algorithm for optimal margin classifiers,” in Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, pp. 144–152, 1992.
View at: Google Scholar
A. Statnikov, L. Wang, and C. F. Aliferis, “A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification,” BMC Bioinformatics, vol. 9, article 319, 2008.
View at: Publisher Site | Google Scholar
A. Statnikov, C. F. Aliferis, I. Tsamardinos, D. Hardin, and S. Levy, “A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis,” Bioinformatics, vol. 21, no. 5, pp. 631–643, 2005.
View at: Publisher Site | Google Scholar
C. F. Aliferis, I. Tsamardinos, and A. Statnikov, “HITON: a novel Markov Blanket algorithm for optimal variable selection,” Proceedings of the AMIA Annual Symposium, pp. 21–25, 2003.
View at: Google Scholar
I. Guyon, J. Weston, S. Barnhill, and V. Vapnik, “Gene selection for cancer classification using support vector machines,” Machine Learning, vol. 46, pp. 389–422, 2002.
View at: Google Scholar
F. E. Harrell Jr., K. L. Lee, and D. B. Mark, “Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors,” Statistics in Medicine, vol. 15, no. 4, pp. 361–387, 1996.
View at: Publisher Site | Google Scholar
V. Sindhwani, P. Bhattacharyya, and S. Rakshit, “Information theoretic feature crediting in multiclass support vector machines,” in Proceedings of the 1st SIAM International Conference on Data Mining, 2001.
View at: Google Scholar
N. Fananapazir, M. Li, D. Spentzos, and C. F. Aliferis, “Formative evaluation of a prototype system for automated analysis of mass spectrometry data,” in Proceedings of the AMIA Annual Symposium, pp. 241–245, 2005.
View at: Google Scholar
S. R. Master, “Diagnostic proteomics: back to basics?” Clinical Chemistry, vol. 51, no. 8, pp. 1333–1334, 2005.
View at: Publisher Site | Google Scholar
E. P. Diamandis, “Is early detection of cancer with serum biomarkers or proteomics profiling feasible?” AACR Education Book, pp. 129–132, 2007.
View at: Google Scholar
M. Kinter and N. E. Sherman, Protein Sequencing and Identification Using Tandem Mass Spectrometry, John Wiley & Sons, New York, NY, USA, 2000.
D. C. Liebler, Introduction to Proteomics: Tools for the New Biology, Humana Press, Totowa, NJ, USA, 2002.

Copyright

Copyright © 2009 Nafeh Fananapazir et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1137

Downloads

1025

Citations