Table of Contents Author Guidelines Submit a Manuscript
Journal of Healthcare Engineering
Volume 2018, Article ID 8961781, 13 pages
https://doi.org/10.1155/2018/8961781
Research Article

Gastric Pathology Image Classification Using Stepwise Fine-Tuning for Deep Neural Networks

1Department of Intelligent Interaction Technologies, University of Tsukuba, Tsukuba 305-8573, Japan
2Department of Surgical Pathology, Toho University Sakura Medical Center, Sakura 285-8741, Japan
3Artificial Intelligence Research Center, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba 305-8560, Japan

Correspondence should be addressed to Jia Qu; pj.ca.abukust.u@9120331s

Received 23 March 2018; Revised 14 May 2018; Accepted 27 May 2018; Published 21 June 2018

Academic Editor: Santosh K. Vipparthi

Copyright © 2018 Jia Qu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. Ferlay, I. Soerjomataram, R. Dikshit et al., “Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012,” International Journal of Cancer, vol. 136, no. 5, 2015. View at Publisher · View at Google Scholar · View at Scopus
  2. S. J. Robboy, S. Weintraub, A. E. Horvath et al., “Pathologist workforce in the United States,” Archives of Pathology and Laboratory Medicine, vol. 137, no. 12, pp. 1723–1732, 2013. View at Publisher · View at Google Scholar · View at Scopus
  3. The Japanese Society of Pathology, The Japanese Society of Pathology Guideline, The Japanese Society of Pathology, Japan, 2015.
  4. How Telemedicine Answers Global Pathology Demands, 2018, https://proscia.com/blog/2015/07/14/global-crisis-digital-solution.
  5. A. O. Morrison and J. M. Gardner, “Microscopic image photography techniques of the past, present, and future,” Archives of Pathology and Laboratory Medicine, vol. 139, no. 12, pp. 1558–1564, 2015. View at Publisher · View at Google Scholar · View at Scopus
  6. P. W. Hamilton, Y. Wang, and S. J. Mccullough, “Virtual microscopy and digital pathology in training and education,” Acta Pathologica, Microbiologica et Immunologica Scandinavica, vol. 120, no. 4, pp. 305–315, 2012. View at Publisher · View at Google Scholar · View at Scopus
  7. M. Jondet, R. Agoli-Agbo, and L. Dehennin, “Automatic measurement of epithelium differentiation and classification of cervical intraneoplasia by computerized image analysis,” Diagnostic Pathology, vol. 5, no. 1, p. 7, 2010. View at Publisher · View at Google Scholar · View at Scopus
  8. A. N. Esgiar, R. Naguib, B. S., Sharif et al., “Microscopic image analysis for quantitative measurement and feature identification of normal and cancerous colonic mucosa,” IEEE Transactions on Information Technology in Biomedicine, vol. 2, no. 3, pp. 197–203, 1998. View at Google Scholar
  9. J. Diamond, N. H. Anderson, P. H. Bartels et al., “The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia,” Human Pathology, vol. 35, no. 9, pp. 1121–1131, 2004. View at Publisher · View at Google Scholar · View at Scopus
  10. K. Masood and N. Rajpoot, “Texture based classification of hyperspectral colon biopsy samples using CLBP,” in Proceedings of International Symposium on Biomedical Imaging: From Nano to Macro, pp. 1011–1014, Boston, MA, USA, July 2009.
  11. O. Sertel, J. Kong, H. Shimada et al., “Computer-aided prognosis of neuroblastoma on whole-slide images: classification of stromal development,” Pattern Recognition, vol. 42, no. 6, pp. 1093–1103, 2009. View at Publisher · View at Google Scholar · View at Scopus
  12. J. N. Kather, C.-A. Weis, F. Bianconi et al., “Multi-class texture analysis in colorectal cancer histology,” Scientific Reports, vol. 6, Article ID 27988, 2016. View at Publisher · View at Google Scholar · View at Scopus
  13. J. Qu, H. Nosato, H. Sakanashi et al., “Cancer detection from pathological images using higher-order local autocorrelation,” in Proceedings of IEEE 2012 11th International Conference on Signal Processing, pp. 1198–1201, Beijing, China, October 2012.
  14. M. Peikari, J. Zubovits, G. Clarke et al., “Clustering analysis for semi-supervised learning improves classification performance of digital pathology,” in Proceedings of International Conference On Medical Image Computing and Computer Assisted Intervention 2015: Machine Learning in Medical Imaging, pp. 263–270, Munich, Germany, October 2015.
  15. A. Tabesh, M. Teverovskiy, H. Y. Pang et al., “Multifeature prostate cancer diagnosis and gleason grading of histological images,” IEEE Transactions on Medical Imaging, vol. 26, no. 10, pp. 1366–1378, 2007. View at Publisher · View at Google Scholar · View at Scopus
  16. K. Nguyen, A. Sarkar, and A. K. Jain, “Structure and context in prostatic gland segmentation and classification,” in Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 115–123, Nice, France, October 2012.
  17. P.-W. Huang and C.-H. Lee, “Automatic classification for pathological prostate images based on fractal analysis,” IEEE Transactions on Medical Imaging, vol. 28, no. 7, pp. 1037–1050, 2009. View at Publisher · View at Google Scholar · View at Scopus
  18. J. Qu, H. Nosato, H. Sakanashi et al., “Computational cancer detection of pathological images based on an optimization method for color-index local auto-correlation feature extraction,” in Proceedings of IEEE 11th International Symposium on Biomedical Imaging, pp. 822–825, Beijing, China, May 2014.
  19. K. Sirinukunwattana, D. Snead, and N. M. Rajpoot, “A novel texture descriptor for detection of glandular structures in colon histology images,” in Proceedings of SPIE Medical Imaging 2015: Digital Pathology, Orlando, FL, USA, March 2015.
  20. D. Shen, G. Wu, and H.-I. Suk, “Deep learning in medical image analysis,” Annual Review of Biomedical Engineering, vol. 19, no. 1, pp. 221–248, 2017. View at Publisher · View at Google Scholar · View at Scopus
  21. R. Marée, “The need for careful data collection for pattern recognition in digital pathology,” Journal of Pathology Informatics, vol. 8, no. 19, 2017. View at Publisher · View at Google Scholar · View at Scopus
  22. H. Chen, X. Qi, and L. Yu, “DCAN: deep contour-aware networks for accurate gland segmentation,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2487–2496, Las Vegas, NV, USA, July 2016.
  23. B. Bejnordi, G. Litjens, N. Timofeeva et al., “Stain specific standardization of whole-slide histopathological images,” IEEE Transactions on Medical Imaging, vol. 35, no. 2, pp. 404–415, 2016. View at Google Scholar
  24. A. Krizhevsky, I. Sutskever, and G. Hinton, “ImageNet classification with deep convolutional neural networks,” in Proceedings of 25th International Conference on Neural Information Processing Systems, vol. 1, pp. 1097–1105, Lake Tahoe, NV, USA, December 2012.
  25. A. Janowczyk and A. Madabhushi, “Deep learning for digital pathology image analysis: a comprehensive tutorial with selected use cases,” Journal of Pathology Informatics, vol. 7, no. 29, 2016. View at Publisher · View at Google Scholar · View at Scopus
  26. K. He, X. Zhang, S. Ren et al., “Deep residual learning for image recognition,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778, Las Vegas, NV, USA, 2016.
  27. T. Durand, T. Mordan, N. Thome et al., “WILDCAT: weakly supervised learning of Deep ConvNets for image classification, pointwise localization and segmentation,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 642–651, Salt Lake City, UT, USA, 2017.
  28. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” in Proceedings of International Conference on Learning Representations, San Diego, CA, USA, May 2015.
  29. N. Dhungel, G. Carneiro, and A. P. Bradley, “Deep learning and structured prediction for the segmentation of mass in mammograms,” in Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 605–612, Munich, Germany, October 2015.
  30. Z. Zhang, Y. Xie, F. Xing et al., “MDNet: a semantically and visually interpretable medical image diagnosis network,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6428–6436, Beijing, China, China 2017.
  31. M. Havaei, A. Davy, D. W. Farley et al., “Brain tumor segmentation with deep neural networks,” Medical Image Analysis, vol. 35, pp. 18–31, 2017. View at Publisher · View at Google Scholar · View at Scopus
  32. G. Carneiro, J. C. Nascimento, and A. Freitas, “The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods,” IEEE Transactions on Image Processing, vol. 21, no. 3, pp. 968–982, 2012. View at Publisher · View at Google Scholar · View at Scopus
  33. Y. Yuan and M. Q. Meng, “Deep learning for polyp recognition in wireless capsule endoscopy images,” Medical Physics, vol. 44, no. 4, pp. 1379–1389, 2017. View at Publisher · View at Google Scholar · View at Scopus
  34. Y. Xu, Z. Jia, L. Wang et al., “Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features,” BMC Bioinformatics, vol. 18, no. 1, p. 281, 2017. View at Publisher · View at Google Scholar · View at Scopus
  35. L. Hou, D. Samaras, and T. M. Kurc, “Patch-based convolutional neural network for whole slide tissue image classification,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2424–2433, Las Vegas, NV, USA, 2016.
  36. J. Xu, X. Luo, G. Wang et al., “A deep convolutional neural network for segmenting and classifying epithelial and stromal regions in histopathological images,” Neurocomputing, vol. 191, pp. 214–223, 2016. View at Publisher · View at Google Scholar · View at Scopus
  37. K. Sirinukunwattana, J. P. W. Pluim, H. Chen et al., “Gland segmentation in colon histology images: the GlaS Challenge Contest,” Medical Image Analysis, vol. 35, pp. 489–502, 2017. View at Publisher · View at Google Scholar · View at Scopus
  38. Z. Han, B. Wei, Y. Zheng et al., “Breast cancer multi-classification from histopathological images with structured deep learning model,” Scientific Reports, vol. 7, no. 1, 2017. View at Publisher · View at Google Scholar · View at Scopus
  39. F. Ciompi, O. Gessinnk, B. E. Bejnordi et al., “The importance of stain normalization in colorectal tissue classification with convolutional networks,” in Proceedings of the IEEE International Symposium in Biomedical Imaging, Melbourne, VIC, Australia, 2017.
  40. M. Shah, C. Rubadue, D. Suster et al., “Deep learning assessment of tumor proliferation in breast cancer histological images,” http://arxiv.org/abs/1610.03467.
  41. H. Chen, Q. Dou, D. Ni et al., “Automatic fetal ultrasound standard plane detectionusing knowledge transferred recurrent neural networks,” in Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 507–514, Granada, Spain, September 2015.
  42. H.-C. Shin, H. R. Roth, M. Gao et al., “Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning,” IEEE Transactions on Medical Imaging, vol. 35, no. 5, pp. 1285–1298, 2016. View at Publisher · View at Google Scholar · View at Scopus
  43. J. Yosinski, J. Clune, Y. Bengio et al., “How transferable are features in deep neural networks?” in Proceedings of the Annual Conference on Neural Information Processing Systems, pp. 3320–3328, Barcelona, Spain, 2014.
  44. S. Christodoulidis, M. Anthimopoulos, and L. Ebner, “Multi-source transfer learning with convolutional neural networks for lung pattern analysis,” IEEE Journal of Biomedical and Health Informatics, vol. 21, no. 1, pp. 76–84, 2017. View at Publisher · View at Google Scholar · View at Scopus
  45. K. Fukushima and S. Miyake, “Neocognitron: a new algorithm for pattern recognition tolerant of deformations and shifts in position,” Pattern Recognition, vol. 15, no. 6, pp. 455–469, 1982. View at Publisher · View at Google Scholar · View at Scopus
  46. C. Szegedy, V. Vanhoucke, S. Ioffe et al., “Rethinking the inception architecture for computer vision,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826, Las Vegas Valley, NV, USA, July 2016.
  47. P. Agrawal, R. Girshick, and J. Malik, “Analyzing the performance of multilayer neural networks or object recognition,” in Proceedings of European Conference on Computer Vision, pp. 329–344, Zurich, Switzerland, September 2014.
  48. A. Babenko, A. Slesarev, A. Chigorin et al., “Neural codes for image retrieval,” in Proceedings of European Conference on Computer Vision, pp. 584–599, Zurich, Switzerland, September 2014.
  49. B. Hariharan, P. Arbeláez, R. Girshick et al., “Simultaneous detection and segmentation,” in Proceedings of European Conference on Computer Vision, pp. 297–312, Zurich, Switzerland, September 2014.
  50. S. Branson, G. Van Horn, S. Belongie et al., “Improved bird species categorization using pose normalized deep convolutional nets,” in Proceedings of British Machine Vision Conference, Nottingham, UK, 2014.
  51. R. Girshick, J. Donahue, T. Darrell et al., “Rich feature hierarchies for accurate object detection and semantic segmentation,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587, Columbus, OH, USA, June 2014.
  52. Z. Zhou, J. Shin, L. Zhang et al., “Fine-tuning convolutional neural networks for biomedical image analysis: actively and incrementally,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 7340–7351, Madison, WI, USA, June 2017.
  53. A. Suzuki, S. Suzuki, S. Kido et al., “A 2-staged transfer learning method with deep convolutional neural network for diffuse lung disease analysis,” in Proceedings of International Forum on Medical Imaging in Asia, pp. 160–163, Quebec City, QC, Canada, September 2017.
  54. M. Guarino, P. Micheli, and F. Pallotti, “Pathological relevance of epithelial and mesenchymal phenotype plasticity,” Pathology–Research and Practice, vol. 195, no. 6, pp. 379–389, 1999. View at Publisher · View at Google Scholar · View at Scopus
  55. B. S. Wiseman and Z. Werb, “Stromal effects on mammary gland development and breast cancer,” Science, vol. 296, no. 5570, pp. 1046–1049, 2002. View at Publisher · View at Google Scholar · View at Scopus
  56. A. C. Ruifrok and D. A. Johnston, “Quantification of histochemical staining by color deconvolution,” Analytical and Quantitative Cytology and Histology, vol. 23, no. 4, pp. 291–299, 2001. View at Google Scholar
  57. N. Phansalkar, S. More, A. Sabale et al., “Adaptive local thresholding for detection of nuclei in diversity stained cytology images,” in Proceedings of the International Conference on Communications and Signal Processing, pp. 218–220, Calicut, India, February 2011.
  58. S. Suzuki and K. Abe, “Topological structural analysis of digitized binary images by border following,” Computer Vision, Graphics, and Image Processing, vol. 30, no. 1, pp. 32–46, 1985. View at Publisher · View at Google Scholar · View at Scopus
  59. O. Russakovsky, J. Deng, H. Su et al., “ImageNet large scale visual recognition challenge,” International Journal of Computer Vision, vol. 115, no. 3, pp. 211–252, 2015. View at Publisher · View at Google Scholar · View at Scopus
  60. M. Sokolova and G. Lapalme, “A systematic analysis of performance measures for classification tasks,” Information Processing and Management, vol. 45, no. 4, pp. 427–437, 2009. View at Publisher · View at Google Scholar · View at Scopus