Computational and Mathematical Methods in Medicine

Computational and Mathematical Methods in Medicine / 2020 / Article
Special Issue

Computational Intelligence Methods for Brain-Machine Interfacing or Brain-Computer Interfacing

View this Special Issue

Research Article | Open Access

Volume 2020 |Article ID 8620403 | https://doi.org/10.1155/2020/8620403

Li Liu, Liang Kuang, Yunfeng Ji, "Multimodal MRI Brain Tumor Image Segmentation Using Sparse Subspace Clustering Algorithm", Computational and Mathematical Methods in Medicine, vol. 2020, Article ID 8620403, 13 pages, 2020. https://doi.org/10.1155/2020/8620403

Multimodal MRI Brain Tumor Image Segmentation Using Sparse Subspace Clustering Algorithm

Guest Editor: Yi-Zhang Jiang
Received22 Apr 2020
Revised24 May 2020
Accepted08 Jun 2020
Published04 Jul 2020

Abstract

Brain tumors are one of the most deadly diseases with a high mortality rate. The shape and size of the tumor are random during the growth process. Brain tumor segmentation is a brain tumor assisted diagnosis technology that separates different brain tumor structures such as edema and active and tumor necrosis tissues from normal brain tissue. Magnetic resonance imaging (MRI) technology has the advantages of no radiation impact on the human body, good imaging effect on structural tissues, and an ability to realize tomographic imaging of any orientation. Therefore, doctors often use MRI brain tumor images to analyze and process brain tumors. In these images, the tumor structure is only characterized by grayscale changes, and the developed images obtained by different equipment and different conditions may also be different. This makes it difficult for traditional image segmentation methods to deal well with the segmentation of brain tumor images. Considering that the traditional single-mode MRI brain tumor images contain incomplete brain tumor information, it is difficult to segment the single-mode brain tumor images to meet clinical needs. In this paper, a sparse subspace clustering (SSC) algorithm is introduced to process the diagnosis of multimodal MRI brain tumor images. In the absence of added noise, the proposed algorithm has better advantages than traditional methods. Compared with the top 15 in the Brats 2015 competition, the accuracy is not much different, being basically stable between 10 and 15. In order to verify the noise resistance of the proposed algorithm, this paper adds 5%, 10%, 15%, and 20% Gaussian noise to the test image. Experimental results show that the proposed algorithm has better noise immunity than a comparable algorithm.

1. Introduction

Tumor is one of the common malignant diseases that endanger human health. According to origin, tumors are generally divided into primary and secondary. Compared with breast, lung, and esophageal tumors, the incidence of brain tumors is relatively low. Compared with the overall incidence of human tumors, it accounts for about 1.4%; however, the mortality rate reaches 2.4% of human tumors [1]. Glioma is the most common primary brain tumor in adults. It is mainly distributed in glial cells and the tissues it infiltrates, and it is the most common malignant brain tumor. According to the nature of tumors, gliomas are generally divided into benign and malignant. Benign gliomas generally grow relatively slowly, patients have a longer survival period, and the long course of disease is the main manifestation of benign gliomas. Malignant gliomas generally grow faster, and the short course is a prominent manifestation of malignant gliomas. If the intracranial lesions can be detected as soon as possible, and the corresponding treatments can be implemented, the health hazards of brain tumors to humans can be reduced. CT or MRI imaging to analyze the pathological state of brain tissue is currently the mainstream method for examining brain tumors. Different imaging techniques have different advantages for tumor diagnosis. Compared with CT imaging, MRI uses a noninvasive imaging method, which can provide the observer with high-quality images without damage and skull artifacts, with clear anatomical structure, and with very good soft tissue resolution. At the same time, intracranial images in any direction can be obtained by adjusting the relevant parameters. In addition, using different imaging sequences, MRI of different angles or modalities of the same tissue can be obtained. This type of image is generally referred to as a multimodal MRI image.

The effective diagnosis of brain tumors requires the successful segmentation of tumors in brain images. Based on the results of the segmentation, the doctor can determine the shape, size, and specific location of the tumor. According to the segmentation results of the tumor in the image, a corresponding treatment plan is given. Due to the increase in the number of patients with brain diseases and the development of intelligent diagnostic technology, the research work based on brain tumors continues to increase. The International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) began in 2012 and has organized competitions based on multimodal brain tumor segmentation for four consecutive years, greatly promoting the development of brain tumor segmentation technology. It is of great research value and practical significance to improve the diagnosis efficiency by mining potential pathological information of MRI brain tumor images through image processing technology and machine learning methods. However, the tumor is only characterized by gray-scale information on the MRI image, and the edge of the tumor structure and the normal tissue have significant gray-scale similarity. Simultaneously, the size, location, shape, and corresponding expansion of the tumor in the brain tissue will show different states with different patients. These characteristics pose challenges to the development of tumor segmentation technology.

The so-called brain tumor segmentation refers to the process of segmenting various tumor tissues from a variety of conventional brain tissues. In general, the segmentation methods of brain tumor images can be summarized into three categories [2]: purely artificial, semiautomatic, and fully automatic segmentation. Manual segmentation refers to manually drawing the outline of the target tissue. Figure 1 is a schematic diagram of manual segmentation. Manual segmentation is boring and time consuming, so it cannot meet the growing demand for segmentation. In addition, each segmenter has a different segmentation style, which leads to deviations in segmentation results. Although manual segmentation has many disadvantages, manual segmentation has the highest segmentation accuracy so far, and is often used as the ground truth for automatic segmentation. Semiautomatic segmentation is sensitive to initialization. Users need to input certain initialization data to get the final segmentation result. Fully automatic segmentation does not need to set any parameters manually and can automatically locate and segment the tumor area.

There is still a lack of a general method that can process all brain tumor images and obtain satisfactory results currently. Usually, the segmentation method is aimed at specific image data. Reviewing related literature, tumor image segmentation methods can be summarized as follows: (1)Threshold based method. The practicability and segmentation effect of this method are very good. The histogram in the global threshold can be expressed as a bimodal model, and a single threshold can be used to distinguish tumor from background. Reference [3] proposes an unsupervised method to enhance pixel grayscale and utilize it to segment brain tumors in T1c images. If there are multiple types of regions in the image, a multithreshold strategy needs to be added to the segmentation method, called local threshold. For the local mean, it can be obtained by estimating the local statistical characteristics, such as gray average [4] and data Gaussian distribution [5]. Generally, the threshold-based method cannot use all the information of the MRI image, and the segmentation result is relatively rough. Therefore, the threshold-based method in brain tumor segmentation is first applied(2)Area-based approach. Through predefined similarity criteria, in the way of merging neighboring pixels in the intersecting areas, the target MRI brain image is divided into the required subareas. Reference [6] applied region growth to MRI tumor segmentation image segmentation with good results. Reference [7] proposed an improved method of region growth. This method obtains a more exact boundary message by reducing the volume effect. The leak gap that may be generated after the division is also filled to a certain extent. As a morphological method, watershed segmentation represents the target contour edge as a partial watershed, which is widely used in brain tumor segmentation. References [8, 9] proposed a multiscale watershed transformation method. Reference [10] constructed an artificially assisted segmentation method by the hierarchical watershed method. From the principle of the watershed segmentation method, this kind of image edge and region watershed conversion easily produces oversegmentation. In order to solve this problem, some related processing methods have been excavated one after another(3)Pixel classification method. The collected MRI brain tumor data generally has two formats, namely, 2D slices and 3D volume. If it is a brain tumor segmentation based on slice format, its essence is the same as traditional image segmentation. The pixel-based method mainly uses the pixel characteristics of the image, and uses some related classifiers to classify all the pixels in the brain tissue image, so as to achieve the effect of segmentation. Unsupervised classification is mainly represented by clustering [11, 12]. The core idea is to measure the relationship between tumor tissue and other tissues in the tumor image. The supervised classifier [13, 14] mainly uses those labeled training samples to train the relevant parameters in the model, which has reached the optimal tumor segmentation effect [15].(4)Model-based method. Model-based tumor segmentation methods are mainly 3D-oriented volume data, followed by 2D slice data. The most typical are the active contour model [16] and the level set method [17]. On the basis of these two models, tumor segmentation has formed two schools: the segmentation methods based on the generative algorithm and the discriminant algorithm. The generation algorithm uses the unique information of various organizations to predict the information of brain tissue that cannot be captured in the image [1820]. In some generative models, in order to solve the problem of difficult coding of a priori knowledge of tumors, the diseased tissue of the tumor can be modeled as the desired shape [2123], or it can be inferred using the given patient image and the tumor growth model’s possible location of the tumor structure [24]. Discriminant methods generally require a certain size of training samples [2527]. After many trainings, the processing effect of the discriminant model is more robust to the effects of MRI image artifacts and grayscale information. Figure 2 shows the basic flow of model-based tumor segmentation. For effective training, the first step of this type of method is generally to extract local gray-scale differences [28] or gray-scale distribution and other voxel-wise features [29], and then send these features to the discriminant classifier of the model. In order to combine the advantages of discriminant models and generative models, a method called generative discriminant model [30, 31] was proposed

In this paper, the BRATS 2015 competition database is used as the experimental object, and the traditional segmentation method and the sparse subspace clustering method based on sparse representation are used to segment the brain tumor images. The main innovations of this article are as follows: (1)Introduce the sparse subspace clustering algorithm to achieve brain tumor image segmentation. The advantage of this algorithm is to use low-dimensional data to recover and approximate high-dimensional data, effectively reducing the dimension of high-dimensional data while retaining the correlation between the data. The introduction of this algorithm can solve the problem of excessive data dimension(2)This article focuses on the segmentation of MRI brain tumor images under multimodality. In the single-modality image fusion strategy, a simple and fast linear fusion strategy is selected. Before segmenting multimodal images, the image is preprocessed by superpixel segmentation, feature vectors are extracted, and the data dimension is reduced. Experimental results show that for brain tumor segmentation, multimodal brain tumor information can be used as much as possible to obtain more accurate segmentation results

2.1. Multimodal MRI Brain Tumor Image Introduction

Multimodal MRI images are images of the same tissue under different contrasts obtained through different MR development sequences. When tumors and other lesions occur in brain tissue, water molecules existing in free form in brain tumors begin to undergo lesion reactions, such as tissue edema. In Flair and T2 images, the water molecules in the bound state are displayed in the form of high signals. Therefore, it is theoretically feasible to use Flair modal MRI images as the main basis for segmenting the entire tumor. However, due to some special circumstances, the tumor will also show irregular changes in the Flair image. At this time, the image data of the T2 mode can provide additional reference. Figure 3 depicts three different sets of Flair and T2 images. Among them is (1) the Flair image, (2) the T2 image, and (3) the artificially labeled tumor structure image. The data used in this paper are all from the BRATS 2015 [32] database, and the database includes images in four modes: T1, T1c, T2, and Flair.

2.2. Difficulties in MRI Brain Tumor Image Segmentation

There are many difficulties in the segmentation of MRI brain tumor images. These difficulties can be summarized as follows: (1)The most typical problem of MRI comes from the different nonstandard intensity ranges obtained by different scanners. Because of different magnetic field strengths and acquisition protocols, for the same patient, the brain MRI strength values are also different between hospitals(2)The brain tumor itself has no fixed shape or prior knowledge. Brain pathology can appear anywhere in the brain and can have any shape. In addition, the gray value range of this pathology may overlap with the gray value range of healthy tissues, making segmentation of brain tumors more complicated(3)MRI has nonnegligible white Rician noise during the acquisition process [33](4)Uniform organization is often affected by changes in the spatial intensity of each dimension. This is caused by the bias field effect. The MRI bias affects the smoothed low-frequency signal of the image intensity. This problem requires an offset field correction preprocessing step, which usually increases the intensity value around the brain(5)Large tumors or lesions in the brain may distort the overall structure of the brain, making some procedures impossible to perform. For example, a larger tumor may affect the overall symmetry of the brain, making it impossible to calculate the left-right symmetry feature. In addition, brains with large tumors are difficult to register with healthy brain templates

3. Brain Tumor Image Segmentation Based on Sparse Subspace Clustering Algorithm

Sparse representations are widely used in image segmentation algorithms. Sparse representations can effectively reduce the complexity of data operations and bring convenience to the subsequent processing of data. SSC is a clustering algorithm based on sparse representation and subspace clustering [34]. Before segmentation, the target image needs to be preprocessed.

3.1. Image Preprocessing

Before SSC splits an image, the image needs to be split into superpixels. Superpixels are irregular image blocks composed of a series of adjacent pixels with similar characteristics, such as texture, color, and brightness. It replaces a large number of pixels with a few superpixels, which effectively reduces the amount of data that expresses the features of the picture, thereby reducing the complexity of image postprocessing. Superpixel segmentation algorithms are currently divided into two types, one is based on graph theory, and the other is based on gradient descent, such as Simple Linear Iterative Clustering (SLIC) [35]. The segmentation method based on gradient descent belongs to an iterative segmentation method. First, an initial clustering is given, and then the gradient clustering method is used to modify the result of the previous clustering, and iterate continuously until the convergence condition is satisfied. The superpixel rendering using SLIC segmentation is shown in Figure 4.

3.2. Basic Model

The algorithm is to assume that the data is composed of high-dimensional spatial data, and each data can be represented in a low-dimensional subspace. That is, by letting the data in the high-dimensional space be expressed linearly with the data in the low-dimensional subspace, the low-dimensional subspace to which the data belongs can be clearly known, which is beneficial to the clustering operation. The basic framework of sparse subspace clustering is shown in Figure 5.

The SSC model building process is as follows.

Given a set of datasets , the dimension is , located in linear subspaces . The dimensions of the linear subspace are . Then define the matrix where is a matrix of rank composed of the th subspace data. is the permutation matrix. Subspace clustering is essentially to obtain the matrix.

Subspace representation means that every data in matrix can be linearly represented by data in the same subspace except for itself: where . Formula (1) can be written in matrix form as follows: where is a sparse matrix. In order to make the sparse matrix the most sparse, that is, the nonzero values in matrix are minimized, by obtaining the norm to minimize, we use convex optimization to perform the following process:

However, the solution of the norm is an NP-Hard problem in practical problems. Usually the norm is used to replace the norm to solve, so as to convert the subspace representation model to

3.3. Brain Tumor Image Segmentation Based on Sparse Subspace Clustering

Image segmentation is the process of segmenting images into nonoverlapping regions and extracting ROI from them, while sparse subspace clustering is a process used to cluster data of the same class into the same subspace. An image contains multiple target images with a complex texture structure, but the features on the image are composed of multiple low-dimensional subspace data. Therefore, the sparse subspace clustering algorithm can be used to segment the image. First, divide the image to be divided into multiple superpixel blocks, and divide the superpixel blocks of the same target image into the same subspace, so as to achieve the purpose of extracting the target image. The process is shown in Figure 6.

A variety of modal image fusion strategies use linear fusion. Linear fusion is the simplest multimodal MRI brain tumor image fusion method. It is a pixel-level fusion method, and the processing object is pixels. It is mainly to operate the pixel unit in each modal brain image, so as to comprehensively process the pixel information in each modal brain tumor image. Through the linear fusion operation, multimodal brain images can be converted into single-modal brain images containing multimodal brain tumor tissue information. Thus, multimodal image segmentation is converted into single-modal image segmentation, and the operation of multimodal processing is simplified. The specific operation of linear fusion is as follows: where is the fused image; , , and are the pixel values of , , and at position ; and , , and are the weights of each modal image, and meets . Figure 7 is a fusion image of multimodal images. Using the linear fusion operation, we use the following Flair ratio to obtain the fusion image in the figure: . After preprocessing the fused image, SSC can be used to complete the multimodal image segmentation.

The steps of the SSC-based multimodal image segmentation algorithm are as follows: (1)Input image and use the preprocessing algorithm described in Section 3.1 to divide the fused image into superpixel blocks(2)Extract -dimensional feature vectors from superpixel blocks to form a feature matrix (3)Use the basic model of sparse subspace clustering to obtain the sparse coefficient matrix (4)Calculate the similarity matrix , where(5)The clustering result is obtained by using the spectral clustering algorithm

4. Simulation Experiment Analysis

4.1. Experiment-Related Settings

The comparison algorithms mainly include FCM, SVM, and the top 15 results of the Brats 2015 challenge. The experimental data of this paper is Brats 2015 [28]. The database contains data of two types of patients, those with benign tumors and those with malignant tumors, and contains brain image data of 274 patients. Each patient’s brain image data contains Flair images, T1 images, T1c images, T2 images, and golden section results. The size of each modal image is . We randomly selected data from 25 patients with brain tumors. Each patient’s data includes five parts, namely, the Flair mode, the T1 mode, the T1c mode, the T2 mode, and the golden section results. The data size of each mode is . Because the two-dimensional tumor pictures of the same patient are similar, a set of two-dimensional multimodal brain tumor images is extracted from the data of each patient. There was a total of 25 sets of multimodal brain tumor image data. Among them, there are 15 groups of malignant tumor data and 10 groups of benign tumor data.

The performance of the algorithm in this paper mainly depends on the quality of the superpixels. The quality of the superpixels is controlled by the number of the superpixels and the compact factor . In this paper, the SLIC superpixel segmentation method needs to consider the density factor and the number of target superpixel blocks [36]. In order to study the influence of the density factor , the numberof predefined superpixel blocks is 1000 at first. Then, we explore the impact of the change of the compact factor size on the segmentation results. The compact factor leads to a more rigid boundary, while will produce a very flexible boundary, but it will increase the shape and irregularity of the superpixel. Figure 7 is the result of FLAIR image segmentation when the value of is different. By visually checking the superpixel boundary and area, when , the boundary can obtain a better segmentation result.

The next step is to determine the number of target superpixel blocks. Figure 8 shows the result of the FLAIR image segmentation when the value of is 20 and the number of the target superpixel blocks is different. When the compaction factor is fixed at , by changing the numberof the target superpixel blocks, the Dice measure is used to evaluate the formation performance of the superpixels.

Based on the above experimental results, the compact factor in this experiment and the number of superpixels . The fuzzy factor in FCM is 2, and the parameter in SVM .

4.2. Evaluation Index

There are four evaluation indicators commonly used in objective evaluation criteria, namely, the Dice coefficient, the Jaccard coefficient, the false positive rate (Precision), and the true positive rate (Recall). The four evaluation indicators are shown in Table 1.


NumberIndexExplanation

1The Dice coefficient is a set similarity measurement method. In the image, it mainly refers to the degree to which the actual segmentation result and the golden segmentation result overlap each other, and the value is . Among them, 0 represents that there is no overlap between the actual segmentation result and the golden segmentation result, which represents the worst segmentation accuracy at this time, and 1 represents that the actual segmentation result and the golden segmentation result completely overlap, which represents the optimal segmentation accuracy at this time.
2The Jaccard coefficient is a method similar to the Dice coefficient that relies on similarity as a measure. It describes the degree of overlap between the actual segmentation result and the golden segmentation result from another perspective.
3The false positive rate (Precision) reflects the accuracy of the actual segmentation result. The ratio of the overlap between the actual segmentation result and the golden segmentation result is used for description. The higher the ratio, the higher the proportion of the golden result included in the actual segmentation result.
4The true positive rate (Recall) reflects the accuracy of the actual results in the actual segmentation results. It refers to the ratio of the overlap between the actual and golden section results. The higher the ratio, the higher the proportion of the true segmentation result in the golden section.

4.3. Simulation Results and Analysis

Table 2 shows the evaluation index results of the algorithm for different groups of multimodal image segmentation results, and Table 3 shows the top 15 segmentation results of the Brats 2015 challenge. It can be seen from the comparison of the data in the table that the average Dice index of this algorithm is 0.8577. Compared with the top 15 of the Brats 2015 competition, the accuracy is not much different, and it can even exceed the results of several of the rankings. The average Precision index is as high as 0.9615, which is a big advantage compared with the top 15 data. Compared with the top 15, the true positive rate is slightly inadequate. This is because the top 15 competition algorithms use a deep learning algorithm to segment the tumor in three dimensions and use the three-dimensional information of the brain tumor. Considering comprehensively, the algorithm in this paper can use the two-dimensional information of brain tumors to obtain a segmentation accuracy similar to the top 15 algorithms in the competition. It can be seen that the algorithm in this paper has certain value.


Experimental sampleIndex
DiceJaccardPrecisionRecall

Malignant tumor10.89230.80420.96270.8287
20.85960.77520.97480.7789
30.83850.74310.92630.7821
40.95070.87850.98740.9264
50.93100.78860.98450.7954
60.87460.79640.96780.8103
70.91520.85220.90340.9371
80.83860.73710.99760.7352
90.87310.77960.99480.7911
100.86940.76490.95630.8002
110.86270.76280.99150.7832
120.70160.53640.99970.5349
130.80180.67420.93060.7132
140.82200.69760.97360.7120
150.81290.68420.96370.7058
Bright tumor10.79610.64250.92640.6779
20.81290.84130.97790.8646
30.92980.66240.98360.6732
40.94010.68300.73750.9118
50.92280.86980.99900.8769
60.94180.88910.98620.8996
70.71470.55100.99960.5534
80.77530.62560.96760.6394
90.90270.82440.98340.8426
100.86240.76320.96230.7824
Mean0.85770.74510.96150.7743


RankDicePrecisionRecall

10.87300.87150.8916
20.87100.86210.9140
30.87200.85310.8633
40.85110.86190.8633
50.87390.85320.9180
60.86500.85300.9011
70.83250.83440.8457
80.86700.86230.8820
90.77600.74750.8635
100.85130.82480.9150
110.84170.83450.8917
120.85800.87160.8635
130.85120.83430.8916
140.83270.85270.8363
150.83280.80550.9090

Table 4 shows the comparison of the average evaluation indexes of these three algorithms in 25 sets of data tests. From the comparison of the data in the table, we can see that the SSC algorithm used in each index is greatly improved compared to the other two algorithms.


MethodsEvaluation index
DiceJaccardPrecisionRecall

FCM0.71100.55640.72050.6975
SVM0.80120.70560.90130.7558
SSC0.85770.74510.96150.7743

Figure 9 is a comparison of the histograms of the various evaluation methods on the four evaluation indicators. From the figure, the greater advantages of the SSC algorithm can be clearly found.

In order to verify the noise resistance of the SSC algorithm, this paper adds 5%, 10%, 15%, and 20% Gaussian noise to the original image. The segmentation results after noise addition are shown in Tables 58. From the changing trends of the values of the four evaluation indicators in Tables 58, it can be analyzed that the tumor segmentation effect decreases with increasing noise. The greater the noise content, the worse the segmentation effect. This is completely consistent with theory.


Experimental sampleIndex
DiceJaccardPrecisionRecall

Malignant tumor10.81230.77580.90360.8080
20.80160.74690.92290.7568
30.80010.71540.90860.7735
40.84620.83690.93210.8858
50.85280.74270.96500.7804
60.81340.75280.94870.7940
70.83470.82740.89360.9166
80.80060.71440.93760.7130
90.81040.74230.97210.7668
100.81100.74170.93250.7878
110.82340.73260.96390.7626
120.68410.51460.96880.5229
130.76950.61550.91290.7007
140.79960.66390.96390.7013
150.80050.65820.94700.6982
Bright tumor10.74860.63010.90030.6663
20.79520.82040.95750.8452
30.89850.64710.95880.6620
40.86250.65980.71760.9031
50.85630.84460.94250.8206
60.90120.83960.93930.8759
70.68520.53290.95790.5414
80.74100.60120.94930.6225
90.88630.80710.93890.8223
100.84010.75400.95220.7639
Mean0.81100.71670.93150.7557


Experimental sampleIndex
DiceJaccardPrecisionRecall

Malignant tumor10.75850.71470.84520.7581
20.76620.70200.89670.7052
30.75960.69960.87460.7196
40.80080.79890.90030.8320
50.80200.70110.91140.7404
60.76420.71020.90950.7462
70.80010.78340.84820.8346
80.77790.69960.90630.6730
90.78230.70320.91010.7162
100.78630.71420.90110.7285
110.79030.70200.90390.7126
120.65230.50110.90080.5028
130.71240.60310.85570.6896
140.72100.63130.89320.6745
150.76950.62200.87120.6512
Bright tumor10.71030.61020.81030.6326
20.75330.79450.84100.8071
30.81200.61030.81240.6426
40.82360.61200.67310.8426
50.80220.80080.85260.7945
60.84710.81060.89890.8142
70.63260.50300.90090.5231
80.70020.59360.88550.6005
90.83080.78520.87970.8030
100.80010.72620.87220.7103
Mean0.76620.68530.87020.7142


Experimental sampleIndex
DiceJaccardPrecisionRecall

Malignant tumor10.70100.62350.77880.6963
20.71210.64170.82930.6625
30.70060.65820.81260.6741
40.72590.71280.82530.6701
50.73610.67330.82560.6693
60.71400.66820.78960.6642
70.72630.71170.75260.6723
80.70300.63360.78640.6008
90.72340.64020.81240.6037
100.70260.65130.81020.6395
110.72630.64120.80060.6279
120.61360.45620.81520.4963
130.67420.58460.78520.6230
140.68920.60060.79840.6172
150.72110.60010.80100.6003
Bright tumor10.69820.58950.71420.6110
20.71200.73120.72650.6753
30.73610.57420.74160.5996
40.72160.58630.62460.7582
50.71210.73230.76930.7296
60.71320.71250.82630.7369
70.60300.48520.80820.5020
80.64820.56110.80600.5801
90.74130.72300.81320.6778
100.71430.67360.80070.6256
Mean0.70280.63460.78620.6405


Experimental sampleIndex
DiceJaccardPrecisionRecall

Malignant tumor10.60130.55820.57860.6030
20.62300.56310.60230.5436
30.60580.54770.61130.5633
40.60030.56930.60370.5721
50.61460.57460.60120.5126
60.60080.58320.59630.5362
70.60010.57460.57480.5284
80.62000.53650.58360.5369
90.59630.52080.58620.5623
100.59820.53000.59160.5123
110.59960.56130.57460.5023
120.53420.42030.58420.4523
130.58460.51100.55320.5203
140.57680.50300.56310.5417
150.56360.50070.57110.5731
Bright tumor10.58750.51140.53690.5324
20.59390.56300.52840.6064
30.57420.50230.57480.5412
40.59360.54310.53030.6234
50.57680.56230.59230.6127
60.56930.56650.58300.6471
70.52340.45280.57460.4864
80.52360.52200.58220.5520
90.57410.53600.56230.6113
100.56980.51420.57220.5436
Mean0.58420.53310.57650.5527

Table 9 gives a comparison of the segmentation performance of the three algorithms under different noise ratios. Each data in the table is the average value of the above 25 sample data after division. Figure 10 shows the changing trend of the segmentation accuracy of the three algorithms with increasing noise. It can be concluded from Table 9 and Figure 10 that the SSC algorithm is relatively better in terms of the antinoise performance of the three algorithms. As the amount of noise increases, the performance of FCM declines the fastest, followed by SVM, and the relative decline of SSC is smaller. This further illustrates the feasibility and reference value of the SSC algorithm selected in this paper.


Noise ratioAlgorithmDiceJaccardPrecisionRecall

5%FCM0.70020.53160.70100.6753
SVM0.79120.69020.89560.7412
SSC0.84100.73670.95150.7657
10%FCM0.68330.52410.69310.6595
SVM0.78000.67890.87630.7286
SSC0.83620.73530.94020.7542
15%FCM0.66580.50560.67670.6323
SVM0.76820.65740.85530.7001
SSC0.82680.72460.93620.7405
20%FCM0.63120.47120.64200.6125
SVM0.74040.63100.82110.6803
SSC0.81820.71310.92650.7327

5. Conclusion

Different features have different effects on tumor segmentation results. In order to make better use of multimodal brain tumor image information, this paper proposes an SSC-based multimodal brain tumor image segmentation method. First, linear fusion is used to fuse multiple single-modality brain MRI images into one image to be processed; secondly, superpixel features are extracted to construct a feature matrix; and finally, a sparse subspace clustering algorithm based on sparse representation is used to complete the segmentation. Using Brats 2015 competition data to experiment with the proposed method, the results show that the method used can well integrate the tumor information of the multimodal images and obtain good segmentation results. After adding different proportions of noise, the segmentation performance of the proposed algorithm decreases significantly slower than that of the comparison algorithm, which also verifies that the proposed algorithm has good noise resistance. However, the method used in this paper has certain limitations. It needs to optimize the weights of various modal data fusions, which is very time consuming.

Data Availability

The labeled dataset used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflicts of interest.

Acknowledgments

This work was supported by the Natural Science Foundation of Jiangsu Province (BK20131097), the Jiangsu Province Higher Vocational Education Industry-Education Integration Platform Construction Project, the Jiangsu Province High-Level Backbone Professional Construction Project, the Jiangsu Province 333 High-Level Talent Cultivation Project ((2016) III-2887), and the Jiangsu Province Key Education Reform Project “Internet of Things Application Technology” Cross-Border Integration “Exploration and Practice of Project-Based Curriculum System Optimization” (2017JSJG077).

References

  1. R. Siegel, D. Naishadham, and A. Jemal, “Cancer statistics, 2013,” CA: a Cancer Journal for Clinicians, vol. 63, no. 1, pp. 11–30, 2013. View at: Publisher Site | Google Scholar
  2. N. Gordillo, E. Montseny, and P. Sobrevilla, “State of the art survey on MRI brain tumor segmentation,” Magnetic Resonance Imaging, vol. 31, no. 8, pp. 1426–1438, 2013. View at: Publisher Site | Google Scholar
  3. P. Gibbs, D. L. Buckley, S. J. Blackband, and A. Horsman, “Tumour volume determination from MR images by morphological segmentation,” Physics in Medicine and Biology, vol. 41, no. 11, pp. 2437–2446, 1996. View at: Publisher Site | Google Scholar
  4. A. Stadlbauer, E. Moser, S. Gruber et al., “Improved delineation of brain tumors: an automated method for segmentation based on pathologic changes of 1H-MRSI metabolites in gliomas,” NeuroImage, vol. 23, no. 2, pp. 454–461, 2004. View at: Publisher Site | Google Scholar
  5. K. J. Shanthi and M. S. Kumar, “Skull stripping and automatic segmentation of brain MRI using seed growth and threshold techniques,” in 2007 International Conference on Intelligent and Advanced Systems, pp. 422–426, Kuala Lumpur, Malaysia, 2007. View at: Publisher Site | Google Scholar
  6. M. R. Kaus, S. K. Warfield, A. Nabavi, P. M. Black, F. A. Jolesz, and R. Kikinis, “Automated segmentation of MR images of brain tumors,” Radiology, vol. 218, no. 2, pp. 586–591, 2001. View at: Publisher Site | Google Scholar
  7. S. Lakare and A. Kaufman, “3D segmentation techniques for medical volumes,” in Center for Visual Computing, Department of Computer Science, State University of New York, 2000. View at: Google Scholar
  8. M. Letteboer, W. Niessen, P. Willems, E. B. Dam, and M. Viergever, “Interactive multi-scale watershed segmentation of tumors in MR brain images,” in Proceedings of the IMIVA workshop of MICCAI, pp. 1–6, Utrecht, Netherlands, 2001. View at: Google Scholar
  9. E. Dam, M. Loog, and M. Letteboer, “Integrating automatic and interactive brain tumor segmentation,” in Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004, pp. 790–793, Cambridge, 2004. View at: Publisher Site | Google Scholar
  10. J. E. Cates, R. T. Whitaker, and G. M. Jones, “Case study: an evaluation of user-assisted hierarchical watershed segmentation,” Medical Image Analysis, vol. 9, no. 6, pp. 566–578, 2005. View at: Publisher Site | Google Scholar
  11. M. C. Clark, L. O. Hall, D. B. Goldgof, R. Velthuizen, F. R. Murtagh, and M. S. Silbiger, “Automatic tumor segmentation using knowledge-based techniques,” IEEE Transactions on Medical Imaging, vol. 17, no. 2, pp. 187–201, 1998. View at: Publisher Site | Google Scholar
  12. A. S. Capelle, O. Alata, C. Fernandez, S. Lefevre, and J. C. Ferrie, “Unsupervised segmentation for automatic detection of brain tumors in MRI,” in Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101), pp. 613–616, Vancouver, BC, Canada, 2000. View at: Publisher Site | Google Scholar
  13. P. Qian, Y. Chen, J.-W. Kuo et al., “mDixon-based synthetic CT generation for PET attenuation correction on abdomen and pelvis jointly using transfer fuzzy clustering and active learning-based classification,” IEEE Transactions on Medical Imaging, vol. 39, no. 4, pp. 819–832, 2020. View at: Publisher Site | Google Scholar
  14. P. Qian, Y. Jiang, Z. Deng et al., “Cluster prototypes and fuzzy memberships jointly leveraged cross-domain maximum entropy clustering,” IEEE Transactions on Cybernetics, vol. 46, no. 1, pp. 181–193, 2016. View at: Publisher Site | Google Scholar
  15. B. Yegnanarayana, Artificial Neural Networks, PHI Learning Pvt. Ltd., 2009.
  16. J. Liu, H. W. Jung, A. Dubra, and J. Tam, “Cone photoreceptor cell segmentation and diameter measurement on adaptive optics images using circularly constrained active contour model,” Investigative Ophthalmology & Visual Science, vol. 59, no. 11, pp. 4639–4652, 2018. View at: Publisher Site | Google Scholar
  17. F. Gibou, R. Fedkiw, and S. Osher, “A review of level-set methods and some recent applications,” Journal of Computational Physics, vol. 353, pp. 82–109, 2018. View at: Publisher Site | Google Scholar
  18. Mahalakshmi, H. K. Krishnappa, and D. Jayadevappa, “Automated brain tumor segmentation and identification using MR images,” International Journal of Innovative Technology and Exploring Engineering, vol. 8, no. 12, pp. 2647–2651, 2019. View at: Publisher Site | Google Scholar
  19. B. Fischl, D. H. Salat, E. Busa et al., “Whole brain segmentation: automated labeling of neuroanatomical structure in the human brain,” Neuron, vol. 33, no. 3, pp. 341–355, 2002. View at: Publisher Site | Google Scholar
  20. K. M. Pohl, J. Fisher, J. J. Levitt et al., “A unifying approach to registration, segmentation, and intensity correction,” in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2005, J. S. Duncan and G. Gerig, Eds., pp. 310–318, Springer, 2005. View at: Publisher Site | Google Scholar
  21. M. Prastawa, E. Bullitt, S. Ho, and G. Gerig, “A brain tumour segmentation framework based on outlier detection,” Medical Image Analysis, vol. 8, no. 3, pp. 275–283, 2004. View at: Publisher Site | Google Scholar
  22. D. T. Gering, W. E. L. Grimson, and R. Kikinis, “Recognizing deviations from normalcy for brain tumor segmentation,” in Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002, T. Dohi and R. Kikinis, Eds., pp. 388–395, Springer, 2002. View at: Publisher Site | Google Scholar
  23. M. B. Cuadra, C. Pollo, A. Bardera, O. Cuisenaire, J. G. Villemure, and J. P. Thiran, “Atlas-based segmentation of pathological MR brain images using a model of lesion growth,” IEEE Transactions on Medical Imaging, vol. 23, no. 10, pp. 1301–1314, 2004. View at: Publisher Site | Google Scholar
  24. A. Gooya, K. M. Pohl, M. Bilello et al., “GLISTR: glioma image segmentation and registration,” IEEE Transactions on Medical Imaging, vol. 31, no. 10, pp. 1941–1954, 2012. View at: Publisher Site | Google Scholar
  25. D. Cobzas, N. Birkbeck, M. Schmidt, M. Jagersand, and A. Murtha, “3D variational brain tumor segmentation using a high dimensional feature set,” in 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8, Rio de Janeiro, 2007. View at: Publisher Site | Google Scholar
  26. S. Ho, E. Bullitt, and G. Gerig, “Level-set evolution with region competition: automatic 3-D segmentation of brain tumors,” in Object recognition supported by user interaction for service robots, pp. 532–535, Quebec City, Quebec, Canada, 2002. View at: Publisher Site | Google Scholar
  27. C. H. Lee, S. Wang, A. Murtha, M. R. G. Brown, and R. Greiner, “Segmenting brain tumors using pseudo-conditional random fields,” in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2008, D. Metaxas, L. Axel, G. Fichtinger, and G. Székely, Eds., pp. 359–366, 2008. View at: Publisher Site | Google Scholar
  28. E. Geremia, O. Clatz, B. H. Menze, E. Konukoglu, A. Criminisi, and N. Ayache, “Spatial decision forests for MS lesion segmentation in multi-channel magnetic resonance images,” Neuro Image, vol. 57, no. 2, pp. 378–390, 2011. View at: Publisher Site | Google Scholar
  29. D. Zikic, B. Glocker, E. Konukoglu et al., “Decision forests for tissue-specific segmentation of high grade gliomas in multi-channel MR,” in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2012, N. Ayache, H. Delingette, P. Golland, and K. Mori, Eds., pp. 369–376, Springer, 2012. View at: Publisher Site | Google Scholar
  30. D. Zikic, B. Glocker, E. Konukoglu et al., “Context-sensitive classification forests for segmentation of brain tumor tissues,” in Proc MICCAI-BRATS, pp. 1–8, Nice, France, 2012. View at: Google Scholar
  31. B. H. Menze, E. Geremia, N. Ayache, and G. Szekely, “Segmenting glioma in multi-modal images using a generative model for brain lesion segmentation,” in Proc MICCAI-BRATS (Multimodal Brain Tumor Segmentation Challenge), pp. 22–30, 2012. View at: Google Scholar
  32. B. H. Menze, A. Jakab, S. Bauer et al., “The multimodal brain tumor image segmentation benchmark (BRATS),” IEEE Transactions on Medical Imaging, vol. 34, no. 10, pp. 1993–2024, 2015. View at: Publisher Site | Google Scholar
  33. S. Bauer, R. Wiest, L. P. Nolte, and M. Reyes, “A survey of MRI-based medical image analysis for brain tumor studies,” Physics in Medicine & Biology, vol. 58, no. 13, pp. R97–R129, 2013. View at: Publisher Site | Google Scholar
  34. E. Ehsan and V. René, “Sparse subspace clustering: algorithm, theory, and applications,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 11, pp. 2765–2781, 2013. View at: Publisher Site | Google Scholar
  35. M. Angulakshmi and G. G. Lakshmi Priya, “Walsh Hadamard transform for simple linear iterative clustering (SLIC) superpixel based spectral clustering of multimodal MRI brain tumor segmentation,” IRBM, vol. 40, no. 5, pp. 253–262, 2019. View at: Publisher Site | Google Scholar
  36. A. Radhakrishna, S. Appu, S. Kevin, L. Aurélien, F. Pascal, and S. Sabine, SLIC superpixels, Epfl, 2010.

Copyright © 2020 Li Liu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


More related articles

 PDF Download Citation Citation
 Download other formatsMore
 Order printed copiesOrder
Views1457
Downloads566
Citations

Related articles

Article of the Year Award: Outstanding research contributions of 2020, as selected by our Chief Editors. Read the winning articles.