A Deep Learning Segmentation Approach in Free-Breathing Real-Time Cardiac Magnetic Resonance Imaging

Yang, Fan; Zhang, Yan; Lei, Pinggui; Wang, Lihui; Miao, Yuehong; Xie, Hong; Zeng, Zhu

doi:https://doi.org/10.1155/2019/5636423

BioMed Research International

On this page

Abstract Introduction Materials Methods Results Discussion Conclusion Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2019 | Article ID 5636423 | https://doi.org/10.1155/2019/5636423

A Deep Learning Segmentation Approach in Free-Breathing Real-Time Cardiac Magnetic Resonance Imaging

Fan Yang,^1,2Yan Zhang,³Pinggui Lei,³Lihui Wang,⁴Yuehong Miao,^1,2Hong Xie,³and Zhu Zeng¹

Academic Editor: Kwang Gi Kim

Received20 Apr 2019

Accepted17 Jul 2019

Published30 Jul 2019

Abstract

Objectives. The purpose of this study was to segment the left ventricle (LV) blood pool, LV myocardium, and right ventricle (RV) blood pool of end-diastole and end-systole frames in free-breathing cardiac magnetic resonance (CMR) imaging. Automatic and accurate segmentation of cardiac structures could reduce the postprocessing time of cardiac function analysis. Method. We proposed a novel deep learning network using a residual block for the segmentation of the heart and a random data augmentation strategy to reduce the training time and the problem of overfitting. Automated cardiac diagnosis challenge (ACDC) data were used for training, and the free-breathing CMR data were used for validation and testing. Results. The average Dice was 0.919 (LV), 0.806 (myocardium), and 0.818 (RV). The average IoU was 0.860 (LV), 0.699 (myocardium), and 0.761 (RV). Conclusions. The proposed method may aid in the segmentation of cardiac images and improves the postprocessing efficiency of cardiac function analysis.

1. Introduction

Free-breathing cardiac magnetic resonance (CMR) cine imaging techniques have been developed for the evaluation of cardiac function [1–5]. It is an accurate and reproducible technique for chamber volume, myocardial mass, and stroke volume measurements [5]. Compared with breath-hold CMR cine imaging, it has a short acquisition time and eliminates the unnecessary breath-hold stage. It is beneficial for children and patients who are unable to hold their breath during data acquisition. However, the postprocessing of free-breathing CMR cine imaging is time-consuming and laborious. Although some commercial software could automatically segment the left ventricle (LV) blood pool, LV myocardium, and right ventricle (RV) blood pool contours of end-diastole (ED) and end-systole (ES) frames, manual adjustment of the segmented contour is still required by an expert. However, the procedure could introduce intraobserver and interobserver variability [6]. Hence, a fully automatic segmentation method of ED and ES frames is necessary for improving the postprocessing efficiency of the free-breathing CMR cine imaging.

The segmentation process of cardiac imaging was previously divided into two stages, i.e., localization and segmentation. For the localization task, some studies used variance image [7], the Fourier Transform [8], and the circular Hough transform [9] to locate the heart. Due to the diaphragm motion in free breathing CMR cine imaging, these methods cannot be applied directly for the heart localization, especially for the apex slice. For the segmentation task, the level set was previously widely used for the LV, myocardium, and RV [10–13]. Other methods include threshold, pixel classification, cardiac atlas, shaped registration, and active shape model, among others [6, 14–19]. However, most algorithms require prior information and manual operation. An alternative automatic method to locate and segment the heart from the cardiac image is to use deep learning techniques.

Recently, deep learning approaches have been widely used in medical image segmentation, especially for CMR images [20–35]. Bernard et al. [20] summarized all the types of segmentation methods using deep learning. Avendi et al. [21] presented a combined deformable model and deep learning method for LV segmentation. Ngo et al. [22] proposed a deep learning method combined with the level set for LV segmentation. Tan et al. [23] designed a regression network on the segmentation of short-axis LV. Isensee et al. [24] used an ensemble of modified 2D and 3D U-Net to tackle the segmentation. Baumgartner et al. [25] tested various convolution neural networks with hyperparameters. Zotti et al. [26] proposed an extension of the U-Net for the cardiac segmentation and an automated analysis method for CMR images [27]. Vigneault et al. [28] presented a novel network for localization and semantic segmentation of cardiac images. Zheng et al. [29] applied a novel variant of U-Net for the cardiac segmentation on short axis MRI image. Khened et al. [30] utilized multiscale residual DenseNets for cardiac segmentation. Zhang et al. [31] proposed a novel deep network for the segmentation of myocardial infarction. Bai et al. [32] used a fully convolutional network for CMR image analysis. Qin et al. [33] proposed a motion estimation and segmentation method for cardiac images. Oktay et al. [34] developed neural networks to cardiac image enhancement and segmentation. Romaguera et al. [35] studied the myocardial segmentation with deep learning approach. These methods were successful for cardiac segmentation. However, the image quality of free-breathing CMR imaging is lower than the breath-hold CMR imaging (see Figure 1) [36]. The deep learning techniques for the accurate segmentation of free-breath CMR data remain a challenge.

(a)

(b)

(c)

(d)

As mentioned above, the development of a fully automatic method for the segmentation of free-breathing CMR images could assist experts in analyzing cardiac function. In this paper, we propose a one-stage deep learning network based U-Net [37] for the segmentation of the heart. The LV, LV myocardium, and RV were directly segmented by using presented deep learning model. The ACDC data were used for training, and free-breathing CMR data were used for validation and testing. We also used a random augmentation data strategy during training. The data were only augmented during the training process and were not stored, making it faster than data augmentation before training. Furthermore, we proposed an improved loss function to yield higher segmentation accuracy. The proposed method is validated and tested on free-breathing CMR data. The experimental results validate its accuracy for cardiac segmentation. The layout of the paper is as follows: The datasets are introduced in detail in Section 2; the methods are presented in Section 3; Section 4 demonstrates the experimental results; in Section 5, we discuss and analyze the results; and the conclusions are given in Section 6.

2. Materials

2.1. Free-Breathing CMR Data

The study was approved by the institutional Review Board. Twelve subjects (7 males; 5 females; age 25±4), with informed consent, were recruited for the study. The heart function assessments were carried out using a 3.0T MR scanner (Siemens, Germany). The heart rate was monitored using ECG. Ten short axis slices covering the whole heart from apex to base were imaged using a free-breathing 2D real-time SSFP, to which the Karhunen-Loeve transform filter was applied along the temporal direction to increase the signal-to-noise ratio. The imaging parameters were as follows: slice thickness 8 mm with a 2 mm gap, field of view (FOV) = 340 × 287 mm², pixel spacing = 2.25 mm/pixel, repetition time/echo time (TR/TE) = 2.5/1.1 ms, matrix size = 160 × 128, TPAT=4, bandwidth=1488 Hz/pixel, temporal resolution = 59.5 ms, and cine duration of 5 s for each slice, containing 84 frames covering end-expiration and end-inspiration. The ED and ES frames in end-expiratory stage of each slice of twelve subjects were used to validate the final network model. The segmentation contours for the LV, LV myocardium, and RV of each frame were provided by the radiologist. The ED and ES frames in other respiratory stages of each slice were used for testing.

2.2. 2017 ACDC Data

The data was obtained from the automated cardiac diagnosis challenge (ACDC) data [20], which was initiated at the 2017 MICCAI Segmentation Challenge in the STACOM workshop. It consists of 150 subjects with normal, previous myocardial infarction, dilated cardiomyopathy, hypertrophic cardiomyopathy, and abnormal right ventricle. The data is divided into the training and testing sets, with 100 and 50 cases, respectively. As the training set contains the LV, LV myocardium, and RV contours, we used the training set to determine the parameters for segmentation in our study.

2.3. Data Processing

The ACDC data varied in size from 154 × 224 to 428 × 512. We resized all images to 160 × 128 by bilinear interpolation without any image cropping operations. Since the data acquisition from different imaging acquisition sequences can introduce inconsistencies in image intensity and pixel intensity, the 16-bit images were normalized to 8-bit images. Thereafter, contrast-limited adaptive histogram equalization (CLAHE) [38] was used to enhance the contrast of the grayscale image. Finally, 1902 images (100 subjects) from ACDC data were used for training, and 80 images (4 subjects) and 160 images (8 subjects) from free-breathing CMR data were used for validation and testing, respectively. For the ground truth (labeled image) in the training stage, LV blood pool, LV myocardium, RV blood pool, and background are labeled as 4, 3, 2, and 1, respectively.

3. Methods

3.1. Outline of the Method

The block diagram of the proposed method is shown in Figure 2. In our method, the proposed segmentation network can be divided into two stages: encoder and decoder. The encoder stage was used for CMR image representation and pixel-level classification, and a decoder stage was used to restore the original spatial resolution. To better display the segmentation result, red, green, and blue colors indicate the region of LV, LV myocardium, and RV in Figure 2.

3.1.1. Heart Segmentation

For LV, LV myocardium, and RV segmentation, it was always necessary to initially locate the heart region when using older methods [7–9, 30], which is highly time-consuming especially for the deep learning methods. We proposed a deep learning network based on U-Net and ResNet [39] to directly locate and segment the heart region. Figure 3 demonstrates the architecture of the network for heart segmentation. The architecture consists of a down-sample path (encoder) followed by an up-sample path (decoder) to restore the size of the input image. In the down-sample path (left section in Figure 3), the input image is 160 × 128 in size. The residual block includes two 3 × 3 convolution layers and one 1 × 1 convolution layer which are appended by batch normalization (BN) and subsequently by ReLU activation (see Figure 3). The max pooling of size 2 × 2 is used to down-sample the convolved maps. The dropout layer is used in the bottom of the convolution layer to prevent overfitting. The dropout ratio was set to 0.5. In the up-sample path (right section in Figure 3), the 2 × 2 transposed convolution was used to up-sample the convolved maps. Several skip connections were used to concatenate feature maps between down-sample and up-sample paths, which could provide more feature information for localization and segmentation. A 1 × 1 convolution layer maps the 24 feature channels to 4 classes. The pixel value in the output image of 4 to 1 indicates the LV, LV myocardium, RV, and background, respectively. Thereafter, the loss function layer is used to calculate the loss value from the output of the SoftMax layer.

3.1.2. Loss Function

Previous methods used Dice loss [40] to solve the problem of class imbalance between heart structure and background in cardiac image segmentation. Recently, Sudre et al. presented an improved Dice loss, called generalized Dice loss [41, 42], which is a robust and accurate loss function for unbalanced tasks and is formulated aswhere and are predicted label image and ground truth, respectively, is the number of classes, is number elements along the first two dimensions of or , and is a weighting factor for each class. In our study, some images in the ACDC data did not have full labels, as illustrated in Figure 4. In such cases, =0 and =infinite. To avoid this kind of problem, the loss and are revised and given bywhere =10⁻⁸ is used to avoid the numerical issue of dividing by 0. When =0, the weight of class is determined by the ; it could improve the performance of segmentation.

(a)

(b)

(c)

(d)

3.2. Implementation Details

The heart segmentation network was implemented in Matlab 2019a using a deep learning toolbox and trained on a computer with Nvidia RTX 2080Ti (11GB memory). In the training stage, 1902 images from ACDC data were used for training, and 80 images from free-breathing CMR data were used for validation. In order to prevent the network from overfitting, affine geometric transformation (scaling, rotation, shearing, and translation), gaussian noise, gaussian blur, and elastic deformations were used to augment the training set before training in cardiac images segmentation [24, 30, 43]. However, random augmentation before training increased the training time; therefore we used a random augmentation data strategy during the training process. For each iteration of training, a random combination of transformations was applied on the minibatch images and was not stored in memory. Therefore, different images were used for network training in each iteration as it could help prevent overfitting, especially for data that come from different acquisition protocols. Figure 5 shows the process of data augmentation in training for heart segmentation.

The network was trained by decreasing the proposed loss function using the adaptive moment estimation (ADAM) optimizer [44]. The initial learning rate of 10⁻³ was decayed by 0.98 per epoch, where the minibatch included 16 images. The network weights were initialized using He initialization [45]. L2 regularization weight decay of 10⁻⁴ was added to the loss function to reduce overfitting. Besides, for using random augmentation of the minibatch, the training set was also shuffled in each epoch before training. Since each minibatch was different due to the random augmentation, the learning rate was restored to 10⁻³ every 100 epochs. We used the Dice curve of the minibatch to observe the training process for training and validation sets. The training of the model was discontinued when no improvement in the Dice score was seen (at about 200 epochs). For the present network, it takes about 6 hours to complete the training of 200 epochs.

3.3. Evaluation Criterion

To evaluate the performance of the developed methods, the Dice and intersection over union (IoU) were calculated and compared with the ground truth. The Dice for each class is given bywhere and are predicted and ground truth image of each class (=2, 3, 4). The IoU for each class is defined by

4. Experiments and Results

4.1. Comparison of the Learning Curves of the Proposed Method and U-Net

We trained the proposed network and U-Net by using the same training scheme: the learning rate was restored to 10⁻³ every 100 epochs using the ADAM solver. Other network training settings were the same as described in Section 3.2, and for every epoch the model was evaluated on the validation set. Figure 6 shows the Dice and loss curve of two networks using cross-entropy (CE) loss, improved generalized Dice (IGD) loss, and data augmentation (DA). To observe the learning curves, the validation loss of the proposed model and U-Net with DA decreased consistently with a decrease in training loss, indicating less overfitting on the training set. The convergence speed of both models with IGD loss was faster than CE loss for the validation curve. Furthermore, the proposed network using IGD loss and DA shows the fastest convergence and the lowest loss value when compared to the U-Net model.

(a)

(b)

(c)

(d)

4.2. The Result of Segmentation on Validation and Testing Set

The highest mean Dice score model was selected for segmentation and evaluation. Figures 7 and 8 show the representative segmentation results by the proposed method from apex to basal slices of ED and ES frames on the testing set. Our method gave accurate results for most slices; however, some failure cases were found in basal slices since these slices included other structures such as the pulmonary artery, left ventricle, and right ventricle outflow tract, among other vessels, as demonstrated in Figure 9. The segmentation performances of the proposed network and U-Net on validation and testing sets are summarized and compared in Table 1. The proposed model and U-Net using IGD loss had a better Dice and IoU score than CE loss. Compared to those without DA, both models with DA showed a significant improvement in validation and testing sets. Moreover, the proposed network with IGD and DA showed the best performance in the evaluation of Dice and IoU score.

4.3. The Performance in Different Heart Cycles

Accurate segmentation at ED or ES frames in different heart cycles could help radiologists obtain information about respiratory variations in cardiac motion [2]. Since the testing dataset in other cycles did not provide labeled contours of ED and ES frames, we only used our model to segment LV, LV myocardium, and RV and observed the performance of segmentation. Figure 10 shows the segmentation results of the ED frames in different heart cycles. Our approach obtained better segmentation results of LV and LV myocardium, which are the same as the ED frames of the end-expiratory stage. The segmentation results in different cycles of RV were slightly different due to the influence of respiratory motion.

5. Discussion

Previously, some studies pointed out that the use of data from different imaging protocols could better assess the performance of deep learning algorithms [20]. Inspired by this problem, we presented a novel deep learning network based on U-Net and ResNet for heart segmentation using data from two imaging protocols in our study. The proposed method used a random augmentation data strategy for training. In each iteration of training, a random combination of transformations was applied to the minibatch and was not stored in the program, a strategy that could reduce training time. Moreover, we proposed an improved Dice loss to improve the accuracy of segmentation. The proposed method was fully automated for heart segmentation without requiring any prior knowledge, and the network produced segmentation results at roughly 10 images per second.

Since the deep learning approaches based on U-Net were widely used in CMR image segmentation [24, 26, 29, 37], we selected it as the baseline method to compare with our method. The proposed network required a lower number of learnable parameters (4.4 million) as compared to U-Net (30 million, when initial number of filters was 64 and BN was used) in the study. The designed residual block helped to alleviate the problem of vanishing gradients and improve the performance of feature extraction. Due to the limited free-breathing CMR data, we used ACDC data as a training set and a random augmentation data strategy during the training to solve the problem of lack of data. These images underwent random combination of transformation in each iteration. In this study, the training images approached 377 000 after 200 epochs when the minibatch consisted of 16 images. When using the data augmentation before training strategy, it was very time-consuming to train a large amount of data. However, a large amount of training data helps to train a better model and reduce overfitting. Compared to the data augmentation before training strategy, the training time was much shorter when training the same epochs. The proposed loss function reduced the impartation of class imbalance. In comparison to cross-entropy loss functions, the improved loss function obtained higher Dice and IoU scores. Furthermore, our network has a lower model complexity, which is easy to implement and train own model.

For the reason of no definitive approach to design hyperparameters, such as the number of layers, filter size, and learning rate in the design of the deep learning framework, in our study we selected hyperparameters based on exhaustive methods and then turned to experiments. For example, we tried several initial learning rates ranging from 10⁻² to 10⁻³, and after observing the learning curve, an initial learning rate of 10⁻³ was selected due to the best Dice curve of the validation set. However, the Dice curve did not go up after 100 epochs. We tried to adjust the learning rate to the initial learning rate every 100 epochs using the ADAM optimizer. The validation Dice increased consistently as the training progressed. These training schemes helped the model to reach the highest accuracy of segmentation on the validation set. Although several studies had proved the residual network with a better performance in feature extraction [39], we found that too many residual blocks lead to poor segmentation results in our research. Therefore, we only used one residual block before each max pooling layer. The training time of the improved network was the same as standard U-Net, and the segmentation accuracy was higher according to the experiment results.

A limitation of this work was the basal slice segmentation. This slice included the pulmonary artery, left ventricle and right ventricle outflow tract, and other structures. Compared to other slices, the basal slice occupied a small part of ACDC data. Even with data augmentation, it was hard to improve accuracy using the proposed method. Even for experts, segmenting the basal slice is challenging [20]. Other studies have also reported the failure of the basal slice with deep learning methods [20, 28, 46, 47]. Furthermore, the anatomical structure of ED and ES frames was different due to the influence of respiratory motion in different cardiac cycles and could produce poo segmentation results, especially for supervised deep learning methods. Existing solutions to these problems are to exclude the basal slice in CMR imaging or the use of a larger database, e.g., the UK Biobank [48], might help to enhance segmentation accuracy. Further studies should include the simultaneous cardiac function quantification and segmentation, and so on [49, 50].

6. Conclusion

In this paper, we proposed a fully automatic heart segmentation approach based on deep learning. The designed residual block and improved loss function were used to improve the segmentation performance of the LV, LV myocardium, and RV. A random data augmentation strategy was applied to reduce the training time and alleviate the problem of overfitting. The results showed that the presented method has high segmentation accuracy and stability. It is worth pointing out that it is the first report employing a one-stage deep learning method for the segmentation of free-breathing CMR data. In the future, we aim to develop more methods and test on a larger sample of free-breathing imaging data.

Data Availability

The datasets used and analyzed during the current study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

The authors gratefully thank all the participants and staff of the Affiliated Hospital of Guizhou Medical University. This work was supported partly by the National Natural Science Foundation of China (Grants nos. 81660298, 61661010, and 81760312), the 2011 Collaborative Innovation Program of Guizhou Province (no. 2015-04 to Zhu Zeng), the Nature Science Foundation of Guizhou Province (Qiankehe J No.20152044), the Joint Fund of Guizhou Province Department of Science Technology (NO. LH7208), and Doctoral Research Initiation Fund of the Affiliated Hospital of Guizhou Medical University.

References

Y. Liu, J. Hamilton, S. Rajagopalan, and N. Seiberlich, “Cardiac magnetic resonance fingerprinting technical overview and initial results,” JACC: Cardiovascular Imaging, vol. 11, no. 12, pp. 1837–1853, 2018.
View at: Publisher Site | Google Scholar
K. Holst, M. Ugander, and A. Sigfridsson, “Left ventricular volume measurements with free breathing respiratory self-gated 3-dimensional golden angle radial whole-heart cine imaging – Feasibility and reproducibility,” Magnetic Resonance Imaging, vol. 43, pp. 48–55, 2017.
View at: Publisher Site | Google Scholar
M. Usman, B. Ruijsink, M. Nazir, G. Cruz, and C. Prieto, “Free breathing whole-heart 3D CINE MRI with self-gated Cartesian trajectory,” Magnetic Resonance Imaging, vol. 38, pp. 129–137, 2017.
View at: Publisher Site | Google Scholar
M. B. Bizino, Q. Tao, J. Amersfoort et al., “High spatial resolution free-breathing 3D late gadolinium enhancement cardiac magnetic resonance imaging in ischaemic and non-ischaemic cardiomyopathy: quantitative assessment of scar mass and image quality,” European Radiology, vol. 28, no. 9, pp. 4027–4035, 2018.
View at: Publisher Site | Google Scholar
A. Merlocco, R. Cross, P. Kellman, H. Xue, M. Hansen, and L. Olivieri, “Validation of cmr-derived left ventricular strain measurements by free-breathing motion-corrected cine imaging,” Journal of the American College of Cardiology, vol. 69, no. 11, p. 1448, 2017.
View at: Publisher Site | Google Scholar
C. Petitjean and J. Dacher, “A review of segmentation methods in short axis cardiac MR images,” Medical Image Analysis, vol. 15, no. 2, pp. 169–184, 2011.
View at: Publisher Site | Google Scholar
G. Dharanibai and J. P. Raina, “Automatic localization and segmentation of left ventricle from short axis cine MR images: an image driven method,” Soft Computing Techniques in Vision Science, vol. 395, pp. 87–99, 2012.
View at: Publisher Site | Google Scholar
L. Zhong, J.-M. Zhang, X. Zhao, R. S. Tan, and M. Wan, “Automatic localization of the left ventricle from cardiac cine magnetic resonance imaging: a new spectrum-based computer-aided tool,” PLoS ONE, vol. 9, no. 4, Article ID e92382, 2014.
View at: Publisher Site | Google Scholar
L. Zhong, J.-M. Zhang, X. Zhao, R. S. Tan, and M. Wan, “Automatic localization of the left ventricle from cardiac cine magnetic resonance imaging: a new spectrum-based computer-aided tool,” PLoS ONE, vol. 9, no. 4, Article ID e92382, 12 pages, 2014.
View at: Publisher Site | Google Scholar
Y. Liu, G. Captur, J. C. Moon et al., “Distance regularized two level sets for segmentation of left and right ventricles from cine-MRI,” Magnetic Resonance Imaging, vol. 34, no. 5, pp. 699–706, 2016.
View at: Publisher Site | Google Scholar
C. Arrieta, S. Uribe, C. Sing-Long et al., “Simultaneous left and right ventricle segmentation using topology preserving level sets,” Biomedical Signal Processing and Control, vol. 33, pp. 88–95, 2017.
View at: Publisher Site | Google Scholar
C. Yang, W. Wu, Y. Su, and S. Zhang, “Left ventricle segmentation via two-layer level sets with circular shape constraint,” Magnetic Resonance Imaging, vol. 38, pp. 202–213, 2017.
View at: Publisher Site | Google Scholar
L. Wang, Y. R. Ma, K. Zhan, and Y. D. Ma, “Automatic left ventricle segmentation in cardiac MRI via level set and fuzzy C-means,” in Proceedings of the 2nd International Conference on Recent Advances in Engineering & Computational Sciences (RAECS), 6 pages, 2015.
View at: Google Scholar
V. Tavakoli and A. A. Amini, “A survey of shaped-based registration and segmentation techniques for cardiac images,” Computer Vision and Image Understanding, vol. 117, no. 9, pp. 966–989, 2013.
View at: Publisher Site | Google Scholar
V. Pham and T. Tran, “Active contour model and nonlinear shape priors with application to left ventricle segmentation in cardiac MR images,” Optik - International Journal for Light and Electron Optics, vol. 127, no. 3, pp. 991–1002, 2016.
View at: Publisher Site | Google Scholar
J. Olveres, R. Nava, B. Escalante-Ramírez, E. Vallejo, and J. Kybic, “Left ventricle Hermite-based segmentation,” Computers in Biology and Medicine, vol. 87, pp. 236–249, 2017.
View at: Publisher Site | Google Scholar
C. M. Nambakhsh, J. Yuan, K. Punithakumar et al., “Left ventricle segmentation in MRI via convex relaxed distribution matching,” Medical Image Analysis, vol. 17, no. 8, pp. 1010–1024, 2013.
View at: Publisher Site | Google Scholar
M. Hajiaghayi, E. M. Groves, H. Jafarkhani, and A. Kheradvar, “A 3-D active contour method for automated segmentation of the left ventricle from magnetic resonance images,” IEEE Transactions on Biomedical Engineering, vol. 64, no. 1, pp. 134–144, 2017.
View at: Publisher Site | Google Scholar
C. Petitjean, M. A. Zuluaga, W. Bai et al., “Right ventricle segmentation from cardiac MRI: a collation study,” Medical Image Analysis, vol. 19, no. 1, pp. 187–202, 2015.
View at: Publisher Site | Google Scholar
O. Bernard, A. Lalande, C. Zotti et al., “Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved?” IEEE Transactions on Medical Imaging, vol. 37, no. 11, pp. 2514–2525, 2018.
View at: Publisher Site | Google Scholar
M. R. Avendi, A. Kheradvar, and H. Jafarkhani, “A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI,” Medical Image Analysis, vol. 30, pp. 108–119, 2016.
View at: Publisher Site | Google Scholar
T. A. Ngo, Z. Lu, and G. Carneiro, “Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance,” Medical Image Analysis, vol. 35, pp. 159–171, 2017.
View at: Publisher Site | Google Scholar
L. K. Tan, Y. M. Liew, E. Lim, and R. A. McLaughlin, “Convolutional neural network regression for short-axis left ventricle segmentation in cardiac cine MR sequences,” Medical Image Analysis, vol. 39, pp. 78–86, 2017.
View at: Publisher Site | Google Scholar
F. Isensee, P. F. Jaeger, P. M. Full, I. Wolf, S. Engelhardt, and K. H. Maier-Hein, “Auto-matic cardiac disease assessment on cine-mri via time-series segmentation and domain specific features,” in Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges. STACOM 2017, vol. 10663 of Lecture Notes in Computer Science, pp. 120–129, 2017.
View at: Publisher Site | Google Scholar
C. F. Baumgartner, L. M. Koch, M. Pollefeys, and E. Konukoglu, “An exploration of 2D and 3D deep learning techniques for cardiac mr image segmentation,” in Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges. STACOM 2017, vol. 10663 of Lecture Notes in Computer Science, pp. 111–119, 2017.
View at: Publisher Site | Google Scholar
C. Zotti, Z. Luo, O. Humbert, A. Lalande, and P. M. Jodoin, “GridNet with automatic shape prior registration for automatic MRI Cardiac segmentation,” in Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges. STACOM 2017, vol. 10663 of Lecture Notes in Computer Science, pp. 73–81, 2017.
View at: Google Scholar
C. Zotti, Z. Luo, A. Lalande, and P.-M. Jodoin, “Convolutional neural network with shape prior applied to cardiac MRI segmentation,” IEEE Journal of Biomedical and Health Informatics, vol. 23, no. 3, pp. 1119–1128, 2019.
View at: Google Scholar
D. M. Vigneault, W. Xie, C. Y. Ho, D. A. Bluemke, and J. A. Noble, “Ω-Net (Omega-Net): Fully automatic, multi-view cardiac MR detection, orientation, and segmentation with deep neural networks,” Medical Image Analysis, vol. 48, pp. 95–106, 2018.
View at: Publisher Site | Google Scholar
Q. Zheng, H. Delingette, N. Duchateau, and N. Ayache, “3-D consistent and robust segmentation of cardiac images by deep learning with spatial propagation,” IEEE Transactions on Medical Imaging, vol. 37, no. 9, pp. 2137–2148, 2018.
View at: Publisher Site | Google Scholar
M. Khened, V. A. Kollerathu, and G. Krishnamurthi, “Fully convolutional multi-scale residual DenseNets for cardiac segmentation and automated cardiac diagnosis using ensemble of classifiers,” Medical Image Analysis, vol. 51, pp. 21–45, 2019.
View at: Publisher Site | Google Scholar
N. Zhang, G. Yang, Z. Gao et al., “Deep learning for diagnosis of chronic myocardial infarction on nonenhanced cardiac Cine MRI,” Radiology, vol. 291, no. 3, pp. 606–617, 2019.
View at: Publisher Site | Google Scholar
W. Bai, M. Sinclair, G. Tarroni et al., “Automated cardiovascular magnetic resonance image analysis with fully convolutional networks,” Journal of Cardiovascular Magnetic Resonance, vol. 20, no. 1, 12 pages, 2017.
View at: Publisher Site | Google Scholar
C. Qin, W. Bai, J. Schlemper et al., “Joint learning of motion estimation and segmentation for cardiac MR image sequences,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2018, vol. 11071 of Lecture Notes in Computer Science, pp. 472–480, 2018.
View at: Publisher Site | Google Scholar
O. Oktay, E. Ferrante, K. Kamnitsas et al., “Anatomically constrained neural networks (ACNNs): application to cardiac image enhancement and segmentation,” IEEE Transactions on Medical Imaging, vol. 37, no. 2, pp. 384–395, 2018.
View at: Publisher Site | Google Scholar
L. V. Romaguera, F. P. Romero, C. F. Fernandes Costa Filho, and M. G. Fernandes Costa, “Myocardial segmentation in cardiac magnetic resonance images using fully convolutional neural networks,” Biomedical Signal Processing and Control, vol. 44, pp. 48–57, 2018.
View at: Publisher Site | Google Scholar
F. Yang, Y. He, J. Zhang, and Y. Wu, “Research of left ventricle function analysis using real-time cardiac magnetic resonance imaging,” Sheng Wu Yi Xue Gong Cheng Za Zhi, vol. 32, no. 6, pp. 1279–1283, 2015.
View at: Google Scholar
O. Ronneberger, P. Fischer, and T. Brox, “U-Net: convolutional networks for biomedical image segmentation,” in Proceedings of the MICCAI 2015, vol. 9351, pp. 234–241, 2015.
View at: Publisher Site | Google Scholar
K. Zuiderveld, “Contrast Limited Adaptive Histograph Equalization,” in Graphic Gems IV, Academic Press Professional, San Diego, Calif, USA, 1994.
View at: Google Scholar
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 770–778, July 2016.
View at: Google Scholar
F. Milletari, N. Navab, and S.-A. Ahmadi, “V-Net: fully convolutional neural networks for volumetric medical image segmentation,” in Proceedings of the 4th International Conference on 3D Vision (3DV '16), pp. 565–571, IEEE, October 2016.
View at: Publisher Site | Google Scholar
C. H. Sudre, W. Li, T. Vercauteren, S. Ourselin, and M. J. Cardoso, “Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations,” Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, pp. 240–248, 2017.
View at: Google Scholar
W. R. Crum, O. Camara, and D. L. G. Hill, “Generalized overlap measures for evaluation and validation in medical image analysis,” IEEE Transactions on Medical Imaging, vol. 25, no. 11, pp. 1451–1461, 2006.
View at: Publisher Site | Google Scholar
J. Patravali, S. Jain, and S. Chilamkurthy, “2D-3D fully convolutional neural networks for cardiac MR segmentation,” in Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges. STACOM 2017, vol. 10663 of Lecture Notes in Computer Science, pp. 130–139, 2017.
View at: Publisher Site | Google Scholar
D. P. Kingma and J. L. Ba, “Adam: a method for stochastic optimization,” in Proceedings of the ICLR 2015, 15 pages, 2015.
View at: Google Scholar
K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: surpassing human-level performance on imagenet classification,” in Proceedings of the 15th IEEE International Conference on Computer Vision (ICCV '15), pp. 1026–1034, Santiago, Chile, December 2015.
View at: Publisher Site | Google Scholar
Y. Jang, Y. Hong, S. Ha, S. Kim, and H. Chang, “Automatic segmentation of LV and RV in cardiac MRI,” in Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges. STACOM 2017, vol. 10663 of Lecture Notes in Computer Science, pp. 161–169, 2017.
View at: Publisher Site | Google Scholar
M. Rohé, M. Sermesant, and X. Pennec, “Automatic multi-atlas segmentation of myocardium with SVF-net,” in Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges. STACOM 2017, vol. 10663 of Lecture Notes in Computer Science, pp. 170–177, 2017.
View at: Publisher Site | Google Scholar
S. E. Petersen, P. M. Matthews, J. M. Francis et al., “UK Biobank’s cardiovascular magnetic resonance protocol,” Journal of Cardiovascular Magnetic Resonance, vol. 18, no. 8, 2016.
View at: Publisher Site | Google Scholar
P. Bizopoulos and D. Koutsouris, “Deep learning in cardiology,” IEEE Reviews in Biomedical Engineering, vol. 12, pp. 168–193, 2018.
View at: Publisher Site | Google Scholar
S. Soffer, A. Ben-Cohen, O. Shimon, M. M. Amitai, H. Greenspan, and E. Klang, “Convolutional neural networks for radiologic images: a radiologist's guide,” Radiology, vol. 290, no. 3, pp. 590–606, 2019.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2019 Fan Yang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2853

Downloads

1777

Citations