Table of Contents Author Guidelines Submit a Manuscript
Computational and Mathematical Methods in Medicine
Volume 2013, Article ID 368514, 15 pages
http://dx.doi.org/10.1155/2013/368514
Research Article

Constructing Benchmark Databases and Protocols for Medical Image Analysis: Diabetic Retinopathy

1Machine Vision and Pattern Recognition Laboratory, Department of Mathematics and Physics, Lappeenranta University of Technology (LUT), Skinnarilankatu 34, FI-53850 Lappeenranta, Finland
2Department of Signal Processing, Tampere University of Technology, Korkeakoulunkatu 10, FI-33720 Tampere, Finland
3Department of Ophthalmology, University of Eastern Finland, Yliopistonranta 1, FI-70211 Kuopio, Finland
4Department of Ophthalmology, University of Tampere, Biokatu 14, FI-33520 Tampere, Finland

Received 25 January 2013; Accepted 26 May 2013

Academic Editor: Carlo Cattani

Copyright © 2013 Tomi Kauppi et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. T. Kauppi, Eye fundus image analysis for automatic detection of diabetic retinopathy [Ph.D. thesis], Lappeenranta University of Technology, 2010.
  2. World Health Organization, “Definition, diagnosis and classification of diabetes mellitus and its complications: part 1: diagnosis and classification of diabetes mellitus,” Tech. Rep., World Health Organization Noncommunicable, Geneva, Switzerland, 1999. View at Google Scholar
  3. World Health Organization and The International Diabetes Federation, Diabetes Action Now: An Initiative of the World Health Organization and the International Diabetes Federation, 2004.
  4. G. von Wendt, Screening for diabetic retinopathy: aspects of photographic methods [Ph.D. thesis], Karolinska Institutet, 2005.
  5. T. Kauppi, V. Kalesnykiene, J.-K. Kamarainen et al., “The diaretdb1 diabetic retinopathy database and evaluation protocol,” in Proceedings of the British Machine Vision Conference (BMVC '07), pp. 252–261, University of Warwick, 2007.
  6. T. Kauppi, V. Kalesnykiene, J. K. Kamarainen et al., “Diaretdb1 diabetic retinopathy database and evaluation protocol,” in Proceedings of the Medical Image Understanding and Analysis (MIUA '07), pp. 61–65, 2007.
  7. T. Kauppi, J.-K. Kamarainen, L. Lensu et al., “A framework for constructing benchmark databases and protocols for retinopathy in medical image analysis,” in Intelligent Science and Intelligent Data Engineering, J. Yang, F. Fang, and C. Sun, Eds., vol. 7751 of Lecture Notes in Computer Science, pp. 832–843, Springer, Berlin, Germany, 2012. View at Google Scholar
  8. J.-K. Kamarainen, L. L. Lensu, and T. Kauppi, “Combining multiple image segmentations by maximizing expert agreement,” in Machine Learning in Medical Imaging, F. Wang, D. Shen, P. Yan, and K. Suzuki, Eds., Lecture Notes in Computer Science, pp. 193–200, Springer, Berlin, Germany, 2012. View at Google Scholar
  9. T. Kauppi, J.-K. Kamarainen, L. Lensu et al., “Fusion of multiple expert annotations and overall score selection for medical image diagnosis,” in Proceedings of the 16th Scandinavian Conference on Image Analysis (SCIA '09), pp. 760–769, Springer, 2009.
  10. N. A. Thacker, A. F. Clark, J. L. Barron et al., “Performance characterization in computer vision: a guide to best practices,” Computer Vision and Image Understanding, vol. 109, no. 3, pp. 305–334, 2008. View at Google Scholar
  11. K. H. Zou, “Receiver operating characteristic (roc) literature research,” 2002, http://www.spl.harvard.edu/archive/spl-pre2007/pages/ppl/zou/roc.html.
  12. T. Fawcett, “An introduction to roc analysis,” Pattern Recognition Letters, vol. 27, no. 8, pp. 861–874, 2006. View at Google Scholar
  13. “Diabetic retinopathy database and evaluation protocol (DIARETDB1),” Electronic material (Online), http://www2.it.lut.fi/project/imageret/diaretdb1_v2_1/.
  14. “Image annotation tool (IMGANNOTOOL),” Electronic material (Online), http://www2.it.lut.fi/project/imageret/.
  15. M. A. T. Figueiredo and A. K. Jain, “Unsupervised learning of finite mixture models,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 381–396, 2002. View at Google Scholar
  16. P. Paalanen, J.-K. Kamarainen, J. Ilonen, and H. Kälviäinen, “Feature representation and discrimination based on Gaussian mixture model probability densities—practices and algorithms,” Pattern Recognition, vol. 39, no. 7, pp. 1346–1358, 2006. View at Google Scholar
  17. “Structured analysis of the retina (STARE),” Electronic material (Online), http://www.clemson.edu/ces/.
  18. A. Hoover, V. Kouznetsova, and M. Goldbaum, “Locating blood vessels in retinal images by piece-wise threhsold probing of a matched filter response,” IEEE Transactions on Medical Imaging, vol. 19, no. 3, pp. 203–210, 2000. View at Google Scholar
  19. A. Hoover and M. Goldbaum, “Locating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels,” IEEE Transactions on Medical Imaging, vol. 22, no. 8, pp. 951–958, 2003. View at Google Scholar
  20. “Digital retinal images for vessel extraction (DRIVE),” Electronic material (Online), http://www.isi.uu.nl/Research/Databases/DRIVE/.
  21. J. J. Staal, M. D. Abramoff, M. Niemeijer, M. A. Viergever, and B. van Ginneken, “Ridge-based vessel segmentation in color images of the retina,” IEEE Transactions on Medical Imaging, vol. 23, no. 4, pp. 501–509, 2004. View at Google Scholar
  22. M. Niemeijer, J. Staal, B. van Ginneken, M. Loog, and M. D. Abramoff, “Comparative study of retinal vessel segmentation a new publicly available database,” in Medical Imaging: Image Processing, pp. 648–656, 2004. View at Google Scholar
  23. “Methods to evaluate segmentation and indexing techniques in the field of retinal ophthalmology (MESSIDOR),” Electronic material (Online), http://messidor.crihan.fr/.
  24. “Collection of multispectral images of the fundus (CMIF),” Electronic material (Online), http://www.cs.bham.ac.uk/research/projects/fundus-multispectral/.
  25. I. B. Styles, A. Calcagni, E. Claridge, F. Orihuela-Espina, and J. M. Gibson, “Quantitative analysis of multi-spectral fundus images,” Medical Image Analysis, vol. 10, no. 4, pp. 578–597, 2006. View at Google Scholar
  26. “Retinopathy online challenge (ROC),” Electronic material (Online), http://roc.healthcare.uiowa.edu/.
  27. M. Niemeijer, B. van Ginneken, M. J. Cree et al., “Retinopathy online challenge: automatic of microaneurysms in digital photographs,” IEEE Transactions on Medical Imaging, vol. 29, no. 1, pp. 185–195, 2010. View at Google Scholar
  28. D. Scharstein and R. Szeliski, “A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,” International Journal of Computer Vision, vol. 47, no. 1–3, pp. 7–42, 2002. View at Google Scholar
  29. “Review: retinal vessel image set for estimation of widths (REVIEW),” Electronic material (Online), http://reviewdb.lincoln.ac.uk/.
  30. B. Al-Diri, A. Hunter, D. Steel, M. Habib, T. Hudaib, and S. Berry, “Review—a reference data set for retinal vessel profiles,” in Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 2262–2265, Vancouver, BC, Canada, August 2008.
  31. B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman, “Labelme: a database and web-based tool for image annotation,” International Journal of Computer Vision, vol. 77, no. 1–3, pp. 157–173, 2008. View at Google Scholar
  32. “Application protocol for electronic data exchange in healthcare environments version,” 2.5.1, ANSI Standard, http://www.hl7.org/.
  33. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, “On combining classfiers,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226–239, 1998. View at Google Scholar
  34. S. K. Warfield, K. H. Zou, and W. M. Wells, “Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation,” IEEE Transactions on Medical Imaging, vol. 23, no. 7, pp. 903–921, 2004. View at Google Scholar
  35. T. A. Lasko, J. G. Bhagwat, K. H. Zou, and L. Ohno-Machado, “The use of receiver operating characteristic curves in biomedical informatics,” Journal of Biomedical Informatics, vol. 38, no. 5, pp. 404–415, 2005. View at Google Scholar
  36. P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, “The FERET evaluation methodology for face-recognition algorithms,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090–11104, 2000. View at Google Scholar
  37. E. Bailliere, S. Bengio, F. Bimbot et al., “The BANCA database and evaluation protocol,” in Proceedings of the International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA '03), pp. 625–638, 2003.
  38. M. Everingham and A. Zisserman, “The pascal visual object classes challenge VOC2006 results,” in Proceedings of the ECCV Workshop of VOC, 2006.