Research Article  Open Access
Salim Lahmiri, Mounir Boukadoum, "Hybrid Discrete Wavelet Transform and Gabor Filter Banks Processing for Features Extraction from Biomedical Images", Journal of Medical Engineering, vol. 2013, Article ID 104684, 13 pages, 2013. https://doi.org/10.1155/2013/104684
Hybrid Discrete Wavelet Transform and Gabor Filter Banks Processing for Features Extraction from Biomedical Images
Abstract
A new methodology for automatic feature extraction from biomedical images and subsequent classification is presented. The approach exploits the spatial orientation of highfrequency textural features of the processed image as determined by a twostep process. First, the twodimensional discrete wavelet transform (DWT) is applied to obtain the HH highfrequency subband image. Then, a Gabor filter bank is applied to the latter at different frequencies and spatial orientations to obtain new Gaborfiltered image whose entropy and uniformity are computed. Finally, the obtained statistics are fed to a support vector machine (SVM) binary classifier. The approach was validated on mammograms, retina, and brain magnetic resonance (MR) images. The obtained classification accuracies show better performance in comparison to common approaches that use only the DWT or Gabor filter banks for feature extraction.
1. Introduction
Computeraided diagnosis (CAD) has been the subject of a lot of research as a tool to help health professionals in medical decision making. As a result, many CAD systems integrate image processing, computer vision, and intelligent and statistical machine learning methods to aid radiologists in the interpretation of medical images and ultimately help improve diagnostic accuracy. These systems have been employed to analyze and classify various types of digitized biomedical images, including retina [1, 2], mammograms [3–5], brain magnetic resonance images [6–8], skin cancer images [9, 10], lung images [11, 12], and ulcer detection in endoscopy images [13, 14], just to name a few.
The typical CAD process starts with a segmentation stage to identify one or more regions of interest (ROI) in the image of interest. Then, the ROI(s) is processed for image enhancement and/or feature extraction before classification. Because the segmentation step requires prior knowledge of discriminant image features and its implementation typically calls for numerous parameter settings, recent works have attempted to eliminate it. These approaches realize feature space reduction by applying one or more transforms to the whole image and extracting the feature vector to classify from one or more of the obtained components [3, 5, 7–14].
Texture analysis has played an important role in the characterization of biomedical images. Texture analysis methods can be categorized as statistical, geometrical, and signal processing types [14]. Statistical methods are mainly based on the spatial distribution of pixel gray values, while geometrical approaches depend on the geometric properties of texture primitives. As for signal processing methods, they use texture filtering in the spatial or frequency domain to extract relevant features.
Multiresolution analysis is the most widely employed signal processing technique for characterizing biomedical images due to its capability to obtain high timefrequency resolutions. The wavelettransform family methods are typical examples of multiresolution analysis techniques. The basic wavelet transform [15, 16] starts with a basis function, the mother wavelet, and decomposes a signal into components of different time and frequency scales; longer time intervals are used to obtain lowfrequency information and shorter intervals are used to obtain highfrequency information.
The most commonly used wavelet transform in biomedical image processing is the discrete wavelet transform (DWT) [14] whose discrete time shifting and stretching variables lead to a sparse and efficient representation. The DWT takes an input image and decomposes into four subimage components that characterize it for different orientations in the horizontal and vertical frequency axes. The process can be repeated with one or more subimages if needed. More precisely, the DWT decomposition yields the approximation subband (LL), the horizontal detail subband (LH), the vertical detail subband (HL), and the diagonal detail subband (HH). These describe, respectively, the lowfrequency components in the horizontal and vertical directions, the lowfrequency components in the horizontal direction and highfrequency components in the vertical direction, the highfrequency components in the horizontal direction and lowfrequency components in the vertical direction, and the highfrequency components in both directions. Thus, in essence, the standard DWT algorithm yields horizontal, vertical, and diagonal directional information about the frequency spectrum of an image. However, these three directions may not be sufficient to express all the directional information in digital images, particularly biomedical images [4, 14]. In an attempt to express the directional features more efficiently, several directional wavelet systems have been proposed. These include the Gabor wavelets [17], the dualtree complex wavelet transform (DTCWT) [18], the ridgelet [19], the curvelet [20], and the contourlet [21]. There exist also reports on biomedical applications of Gabor filter banks [22], DTCWT [4], ridgelets [23], curvelets [24], and contourlets [5].
The twodimensional (2D) Gabor filter decomposes an image into components corresponding to different scales and orientations. As a result, it captures visual properties such as spatial localization, orientation selectivity, and spatial frequency. The 2D Gabor filter has real and imaginary parts and is highly flexible in its representation as its parameters can be adapted to the structure of the patterns that one wants to analyze in the image. It is however difficult to find the optimal set of parameters to characterize a given image. In comparison, the DTCWT transform provides directional selectivity, shift invariant features, and complex images. However, it suffers from limited orientation selectivity [25] and redundancy of information [26]. The ridgelet transform is appropriate to capture radial directional details in the frequency domain; in particular it is optimal for representing straightline singularities. However, those structures are not dominant in medical images and are rarely observed in real world images. This limits the suitability of the ridgelet transform to characterize the texture of real images [27]. The curvelet transform is an extension of the ridgelet transform for detecting image edges and singularities along curves while analyzing images at multiple scales, locations, and desired orientations. It is particularly suitable for image features with discontinuities across straight lines. Unfortunately, the curvelet transform is highly redundant [28] and only few choices of mother functions are available for the curvelets as opposed to the many choices available for the standard wavelet transform [29]. Finally, the contourlet transform can capture directional details and smooth contours in a given image. In particular, it is suitable in the analysis of images containing textures and oscillatory patterns. Its main drawback is the high degree of information redundancy and occurrence of artefacts [30, 31].
In past works, we proposed several transformbased approaches to account for directional features in classifying biomedical images. For instance, in the case of brain magnetic resonance images, we proposed a simple methodology in [32, 33] where features are extracted from the LH and HL components of the DWT instead of the more common LL, or image approximation, component. We found that the LH and HL coefficients are efficient at characterizing changes in the biological tissue and help distinguish normal and abnormal image textures. For mammograms, we investigated in [34] a hybrid processing system that sequentially uses the discrete cosine transform (DCT) to obtain the highfrequency component of the mammogram and then applies the Radon transform (RT) to the result in order to extract its directional features. The validation results showed that the RT helps improve the recognition rate of the detection system. In subsequent work, we combined the DWT and RT transforms [35]. The approach targeted the HH component of the DWT decomposition and improved classification accuracy when compared to using the DWT or RT alone or the DCTRT used in [34]. Our previous works clearly showed that directional information helps improve classification accuracy. In addition, the DWTRT detection system was more efficient for classifying normal and abnormal images than the DCTRT, possibly because of the multiresolution capability of the DWT and the fact that it leads to a sparser signal representation than the DCT. Still, the RT cannot capture spatial frequency, a potential feature to improve further the classification accuracy.
In this paper, we describe a hybrid biomedical image processing and classification system that uses both the DWT and Gabor filter as directional transforms and statistical features derived from them for the classification task which is accomplished by support vector machines (SVMs) [36]. As stated before, the DWT is powerful at providing sparse and efficient image representations [14]. However, except for the LH and HL subbands whose coefficients depend on image row and column information, respectively (an effect of the subband coding used by the algorithm), the standard DWT is essentially an image compression tool and it cannot perform directional analysis at arbitrary directions. On the other hand, the Gabor filter can process images in terms of preferred orientations at arbitrary spatial frequencies. Moreover, it provides nonredundant information and can offer high directional selectivity. Thus, combining DWT and Gabor filter banks in sequence may lead to improved feature extraction from biomedical images and better classification of normal versus abnormal images in comparison to using DWT or Gabor filter banks alone. In this hybrid processing scheme, the DWT acts both as highfrequency filter to extract abrupt changes in image texture and image compression engine to reduce image dimensionality and a Gabor filter bank extracts the directional information.
In a preliminary work [37], the previously mentioned DWTGabor hybrid system was successfully applied to mammograms to extract features that allow discriminating normal and cancer images. More specifically, the goal was to detect the presence of malign microcalcifications (specs of calcium in the breast tissue that appear in the mammogram as small bright spots that are scattered or grouped in clusters), whose early detection is important for cancer screening [38, 39]. The results showed the superiority of the approach over simply using the DWT alone. In the present work, we widen our study to retina digital images and brain magnetic resonance images to investigate the effectiveness of the DWTGabor approach across application domains with similar image features. Indeed, the images of some pathologies related to brain, retina, and breast present similar contrast features characterized by abrupt changes in image texture with directional properties (see examples in Figures 1, 2, and 3). For instance, breast cancer is characterized by dense concentration of contrast cells in the biological tissue, cancer in brain magnetic resonance images is often characterized by large cells with high contrast, and many forms of retinopathy are characterized by the presence of spots on the retina or covering the macula. As a result, the DWTGabor hybrid system we have used in our previous work [37] to detect cancer in mammograms could potentially also be applied to brain magnetic resonance images and retina digital images with similar properties. Next is a brief description of the pathologies that were studied in this work.
(a) Normal
(b) Alzheimer’s disease
(c) Glioma
(d) Herpes encephalitis
(e) Metastatic bronchogenic carcinoma
(f) Multiple sclerosis
(a) Normal
(b) Microaneurysms
(c) Circinate
(a) Normal
(b) Abnormal
Circinate retinopathy is a retinal degeneration characterized by a circle of white spots encircling the macula that causes complete foveal blindness [40]; retinal microaneurysms are due to a swelling of the capillaries caused by a weakening of the vessel wall [41] and are considered to be the earliest sign of diabetic retinopathy, among others. Magnetic resonance imaging (MRI) is a noninvasive imaging modality largely used for brain imaging to detect diseases such as Alzheimer’s and multiple sclerosis [6, 8]. Alzheimer’s disease is the most frequent cause of agerelated dementia and multiple sclerosis is a progressive neurological disorder that can result in various dysfunctions [42]. Additional brain pathologies that can be detected from MR images and that are investigated in this work include glioma, herpes encephalitis, and metastatic bronchogenic carcinoma (Figure 1). All of these are characterized by large cells with high contrast, hence the interest in being able to detect them with the same algorithm.
The contribution of our work can be summarized as follows. First, we propose a relatively simple and fast approach to biomedical image characterization that relies on the directional properties of highfrequency components. The DWT is applied first to extract highfrequency components that characterize abrupt changes in the biological tissue and, then, the Gabor filter is applied to the obtained HH subimage to extract directional features. Second, the statistical features extracted from the hybrid DWTGabor transform are processed by an SVM for classification. This statistical binary classifier has proven its efficiency [4–6, 32–35, 37] and ease of tuning in comparison to alternatives such as artificial neural networks. Another desirable feature is its scalability and ability to avoid local minima [36]. Third, contrary to alternatives that focus on ROIs or specific image details, the proposed methodology is of more general reach as three different types of images used for validation show.
The paper is organized as follows. Section 2 reviews previous works related to the automatic classification of normal versus abnormal images in the context of brain magnetic (MR) resonance imaging, mammograms, and retina digital images. Section 3 describes our proposed approach for directional features extraction from biomedical images using discrete wavelet transform followed by Gabor filter banks and support vector machines classifier. Section 4 presents experimental results. Finally Section 5 draws the conclusions and gives future work to be done.
2. Related Works
Mammograms, retina, and MR images are the subject of many research efforts on feature extraction and subsequent classification. Next is a summary of some recent works related to DWTs and/or Gabor filters. In the problem of automatic classification of mammograms, the authors in [3] used Gabor filter banks to process images and nearest neighbour (NN) algorithm as classifier. The obtained classification rate was 80%. In [4] the dualtree complex wavelet transform (DTCWT) and support vector machine (SVM) were employed to classify benign and malignant images. The experimental result achieved 88.64% classification accuracy. The authors in [5] employed the contourlet transform and successive enhancement learning (SEL) weighted SVM to obtain 96.6% correct classification rate. The previous studies all used images of size pixels.
In the problem of retina digital image classification, the authors in [1] employed the Belkyns’s shiftinvariant DWT to classify normal against abnormal retina images of size pixels. The pathologies of the abnormal images included exudates, large drusen, fine drusen, choroidal neovascularization, central vein and artery occlusion, histoplasmosis, arteriosclerotic retinopathy, hemicentral retinal vein occlusion and more. In order to capture texture directional features, they employed normalized gray level cooccurrence matrices (GLCMs). The obtained classification accuracy with linear discriminant analysis (LDA) was 82.2%. The authors in [2] employed the probabilistic boosting algorithm and morphological scale space analysis and GLCM to extract texture features. The purpose was to classify normal images versus drusen images with various texture complexities. The detection accuracy of normal images varied between 81.3% and 92.2%, and that of abnormal images varied between 71.7% and 85.2% depending on texture complexity (grade of pathology). The authors in [43] used four approaches to extract features from retina digital images of size pixels to automatically classify glaucoma images. The first set of features is obtained by taking the pixel intensities as input to principal component analysis. The second features are obtained from Gabor texture filter responses. The third set of features is computed from the coefficients of the fast Fourier transform and the fourth set of features is obtained from the histogram of the intensity distribution of the image. Finally, support vector machines were employed for the classification task. The performance of the classifications using one feature set only was 73% with the histogram features, 76% with the fast Fourier transform coefficients, 80% with the Gabor textures, and 83% with the pixel intensities.
Finally, in the problem of brain MRI classification, the authors in [6] used the wavelet coefficients as input to a support vector machine to classify normal and abnormal Alzheimer’s disease images of size 256 × 256 pixels. The classification accuracy was 98% using SVM with a radial basis kernel. More recently, the authors in [42] used voxels to represent each brain MRI of size 512 × 512 pixels. Using crossvalidated tests, the obtained correct classification rates of normal and Alzheimer images were 90%, 92%, and 78%, respectively, when using classification by SVM, naïve Bayes classifier, and voting feature intervals (VFIs). Still more recently, the authors in [8] employed the DWT to extract features from brain magnetic resonance images of size pixels, and then principal component analysis was used to reduce the dimensions of the features space. The abnormal images included glioma, meningioma, Alzheimer’s, Alzheimer’s plus visual agnosia, Pick’s disease, sarcoma, and Huntington’s disease. The classification accuracies using backpropagation neural network (BPNN) were 100% using learning and testing sets of 33 images each.
In this work, we are interested in how a DWTGaborbased approach for feature extraction may provide better classification results than those reported in the previous works, particularly those based on the DWT alone. The next section provides the details of our methodology.
3. Methodology
The overall methodology proceeds as follows. First, the DWT is applied to the biomedical image to obtain its highfrequency image component since it often contains most of the desired information about the biological tissue [39]. Indeed, sudden changes in the texture of the image are typical indicators of the presence of abnormal biological tissue. Second, a bank of Gabor filters with different scales and orientations is applied to the highfrequency image to obtain Gaborfiltered images along different spatial orientations. Third, statistical features are extracted from the Gaborfiltered images. Finally, the SVM is used to classify the resulting feature vector for final diagnosis. The block diagram of the DWTGabor system is shown in Figure 4. Figure 5 summarizes the DWT approach in comparison.
3.1. Discrete Wavelet Transform
The twodimensional discrete wavelet transform (2DDWT) [14–16] performs a subband coding of an image in terms of spectral spatial/frequency components, using an iterative and recursive process. Figure 6 illustrates the case of twolevel decomposition. The image is first represented by LH, HL, and HH subbands that encode the image details in three directions and an LL subband which provides an approximation of it. The obtained detail or approximation images can be decomposed again to obtain secondlevel detail and approximation images, and the process can be repeated for finer analysis as each iteration doubles the image scale.
The computation of the 2DDWT proceeds from that of the 1DDWT, the discrete version of the onedimensional continuous wavelet transform. The onedimensional continuous wavelet transform of a signal is defined by [7, 8] where stands for a given wavelet function and and are the scale and translation parameters, respectively. The 1DDWT is obtained by sampling and so that (1) becomes that of a sequence. In dyadic sampling, and are, respectively, a power of 2 and multiples thereof, and the sequence elements (wavelet coefficients) are given bywhere represents the discrete scale factor and the discrete translation factor. In other words, and in (1) are replaced by and , respectively.
The onedimensional wavelet decomposition is extended to an image by applying it to the row variable first and then to the column variable of the obtained result [44]. At each step, two subimages are created with half the number of pixels of the row or column that was processed. In the end, an image is decomposed into 4 subimages, each with resolution and preserved scale. However, (1) has only theoretical merit due to the infinite ranges of and . For a practical implementation, the fact that (1) is essentially a measure of correlation between a signal and various wavelets derived from a mother is exploited, and the DWT decomposition is turned into a filtering operation with a sequence of highpass and lowpass filters [45]. Following the notation in [7, 8], the discrete form of (1) can then be written as where coefficients and specify approximation and details components provided by the lowpass and highpass impulse responses, respectively, and the operator performs downsampling by a factor of 2. The onedimensional wavelet decomposition is extended to twodimensional objects by using row and column decompositions as shown in Figure 6. In our work, the most frequently used wavelet (Daubechies4) [25] is considered to extract the HH image component.
3.2. Gabor Filter
The twodimensional (2D) Gabor filter decomposes an image into components corresponding to different scales and orientations [22], thus capturing visual properties such as spatial localization, orientation selectivity, and spatial frequency. The 2D Gabor filter consists of a complex exponential centered at a given frequency and modulated by a Gaussian envelope. Because of the complex exponential, the filter has both real and imaginary parts. The general form of the real part is defined as follows: where and where and are the standard deviations of the Gaussian envelope along the and axes. The parameters and are, respectively, the central frequency and the rotation of the Gabor filter. To obtain the Gaborfiltered image of a given image the 2D convolution operation (*) is performed: The selection of parameters , , , and plays an important role in the filter’s operation. However, no formal technique exists for choosing them and experienceguided intuition, trial and error, or heuristic search must be used. For retina digital images and brain MR images, and were arbitrarily set to unity. In the case of mammograms, and were set to the values used in [46], which were determined empirically. Consequently, we used , where is the full width at halfmaximum of the Gaussian and . No values of and other than the previous ones were tried since optimality was not the primary concern of this work and we obtained satisfactory results with these values.
Four orientations, , , , and , were used as in [22, 33]. These values seemed reasonable as a first try since they covered both image axis directions and the forward and backward diagonals. Finally, the central frequency was set to 2, 2.5, and 3. Given that the Gabor filter is modulated by the cosine of , large values of lead to a compressed cosine and, consequently, the filter output is more likely to show fast or frequent changes in biological tissue texture. This in turn would help verify our hypothesis that abnormal images are characterized by sudden and frequent variations in image texture. In the end, the application of the Gabor filter bank to the HH image component obtained with the 2DDWT leads to twelve Gaborfiltered HH images components, for each choice of and .
3.3. Feature Extraction
Statistical measures are employed to extract features from both the DWT HH subband image and the real Gaborfiltered HH image components. More precisely, the entropy () and uniformity () of the coefficients of each one are computed. Entropy and uniformity were selected as features because previous works on mammograms have shown that uniformity is correlated with suspicious malignancy [47] and that entropy can successfully characterize breast biological tissue [48]. In this study, the entropy and uniformity statistics are hypothesized to also characterize retina and brain MR images with similar contrast information (i.e., abrupt and/or frequent variations in texture). Entropy () and uniformity () are defined by [49] where is a random variable that represents a coefficient in the Gabor filtered image and is its probability of occurrence as estimated by its relative frequency.
To investigate the performance of the previous approaches, the image features were extracted from HH at both levelone DWT decomposition (HH1) and leveltwo DWT decomposition (HH2), with and without filtering by a Gabor filter bank. We also applied the Gabor filter directly to the original image without the DWT for comparison purpose. For each DWT HH subband image, the feature vector is given by where is the level of wavelet analysis (decomposition). Similarly, for each of the twelve outputs generated by the Gabor filter bank (4 angles × 3 central frequencies), the entropy and uniformity are computed and a twentyfour component feature vector is formed to represent the initial image. We thus have Either feature vector is subsequently fed to the SVM to classify normal versus pathological images.
3.4. The Support Vector Machine Classifier
Introduced by Vapnik [36], the support vector machine (SVM) classifier is based on statistical learning theory. It implements the principle of structural risk minimization and has excellent generalization ability as a result, even when the data sample is small. Moreover, SVM can tolerate highdimensional and/or incomplete data [50]. It has been used with great success in various applications, including speech emotion recognition [51], cardsharing traffic detection [52], fault diagnosis [53], cardiac decision making [54], Parkinson’s disease diagnosis [55], and Alzheimer’s disease detection [56].
The support vector machine performs classification tasks by constructing an optimal separating hyperplane that maximizes the margin between the two nearest data points belonging to two separate classes. Given a training set , where the input and class labels , the separation hyperplane for a linearly separable binary classification problem is given by where is a weight vector and is a bias. The optimal separation hyperplane is found by solving the following optimization problem: where is a penalty parameter that controls the tradeoff between the complexity of the decision function and the number of misclassified training examples and is a positive slack variable. The previous optimization model can be solved by introducing Lagrange multipliers and using the KarushKuhnTucker theorem of optimization to obtain the solution as The values corresponding to positive Lagrange multipliers are called support vectors which define the decision boundary. The values corresponding to zero are irrelevant. Once the optimal solution is found, the optimal hyperplane parameters and are determined. Then, the discriminant function of the SVM for a linearly separable binary classification problem is [32] In the nonlinearly separable case, the SVM classifier nonlinearly maps the training points to a highdimensional feature space using a kernel function , where linear separation can be possible. The scalar product is computed by Mercer kernel function as . Then, the nonlinear SVM classifier has the following form: In this study, a polynomial kernel of degree 2 was used for the SVM. As a global kernel, it allows data points that are far away from each other to also have an influence on the kernel values. The general polynomial kernel is given by where is the degree of the polynomial to be used.
4. Experimental Results
As mentioned previously, mammograms and retina and brain MR images corresponding to given pathologies are considered in this work, and the aim is to classify normal versus abnormal images for each image category. To do so, one hundred digital mammograms (171 × 364 pixels) consisting of fifty normal images and fifty cancer images were taken from The Digital Database for Screening Mammography (DDSM) [57]. For retina, a set of 69 color images (150 × 130 pixels) from the STARE [58] database were employed including 23 normal images, 24 with microaneurysms, and 22 with circinate. Finally, a collection of 56 axial, T2weighted, and MR brain images (256 × 256 pixels) were taken from the AANLIB database [59] of the Harvard Medical School. They consisted of 7 normal images, 9 with Alzheimer’s disease, 13 with glioma, 8 with Herpes encephalitis, 8 with metastatic bronchogenic carcinoma, and 14 with multiple sclerosis. It is unfortunate that the number of images was not constant across pathologies, but we had no control over this and used what was available, with tenfold crossvalidation or leaveoneout crossvalidation of the results depending on sample size. All experiments were based on a binary classification approach of normal versus abnormal images. Many kinds of biomedical images could be considered for our experiments; we focused on mammograms, retina, and brain magnetic resonance images mainly because of public availability. An example of the processing of a normal retina and a retina with circinate is illustrated in Figures 7 and 8, respectively.
(a) Original normal retina image
(b) Normal retina HH1 subimage
(c) Normal retina HH2 subimage
(d) Gabor filtered HH1 at and
(e) Gabor filtered HH2 and
(a) Original retina image with circinate
(b) HH1 subimage
(c) HH2 subimage
(d) Gabor filtered HH1 at and
(e) Gabor filtered HH2 at and
For each image type, the average and standard deviation of the correct classification rate (CCR), sensitivity, and specificity were computed to evaluate the performance feature extraction technique when used in conjunction with the SVM classifier. The three performance measures are defined by where positive samples and negative samples are, respectively, abnormal and normal images.
Finally, all experiments were performed with tenfold crossvalidation, except those for MR images which used leaveoneout crossvalidation due to the small sample size of each brain image category.
Table 1 shows the obtained average results for the three types of images that were investigated. The performance of the SVM classifier improved for all types of images and all levels of HH decomposition by the DWT. At level one, the average correct classification rate increased by, respectively, 0.69, 25.31, and 9.56 percentage points for mammograms, retina, and brain magnetic resonance images when using the DWTGabor approach. At leveltwo decomposition, the improvement was, respectively, 1.96, 9.02, and 5.42 percentage points.
 
Tenfold crossvalidation used for mammograms and retina images, leaveoneout used for brain MRIs. 
Tables 2 and 3 provide the average results for classifier sensitivity and specificity. At levelone DWT decomposition, the DWTGabor approach improved classification specificity for mammograms and retina images to make it reach 100%, while it improved it by 78.03 percentage points for brain MR images. At leveltwo DWT decomposition, the improvement was 3.24 percentage points for mammograms, 97.68 percentage points for retina images (100% specificity), and 97.24 percentage points for MR images. Regarding sensitivity, the results were mixed.
 
Tenfold crossvalidation used for mammograms and retina images, leaveoneout used for brain MRIs. 
 
Tenfold crossvalidation used for mammograms and retina images, leaveoneout used for brain MRIs. 
At levelone DWT decomposition, the values were about the same for the DWTGabor and DWTonly approaches for mammograms and retina images, with, respectively, −0.81 and 0 percentage points differences, but there was a degradation of −11.33 and −46.16 percentage points for brain MR images at level one and level two of decomposition, respectively.
Following the same crossvalidation protocol, we also conducted classification experiments with features extracted from a Gabor filtered image of the original biomedical image. The purpose was to check whether Gaborbased features alone help characterize images better than DWT or DWTGaborbased features. The results are given in Table 4. The obtained correct classification rate of mammograms, retina, and brain magnetic resonance images is, respectively, 68.03% (±0.01), 50.00% (±0.00), and 86.61% (±0.03). The average results for classifier specificity and sensitivity for all images are 100% and 0%. This finding indicates that Gaborbased features are suitable to detect pathological images, but fails to detect normal images. In sum, the results show that Gaborbased features do not perform better than DWT and DWTGaborbased features. These findings confirm the superiority of combining the DWT and Gabor filter banks for feature extraction.

Based on the previous results, it appears that the DWTGabor approach for feature extraction is effective for detecting the abrupt changes in biological tissue that characterize the pathological patterns that were investigated and it yields better classification accuracy and specificity than the DWTonly approach. It also offers equal of better sensitivity, except for brain MRIs. For brain MRIs, the obtained specificity and sensitivity results with the DWTGabor approach show improved true negative detection, but lower true positive performance. Finally, the obtained results reveal also that levelone DWT decomposition is preferable to leveltwo decomposition.
Finally, Table 5 compares the results obtained with the DWTGabor approach to other work that we surveyed. In many cases, the DWTGabor method yields higher classification rates, particularly for mammograms and retina. For the problem of brain MRI classification, our obtained performance is better than the results of [38], but less than what is reported in [6, 8]. However, these comparisons should be viewed with caution as not all the results stem from a common image database and the different authors use different sample and image sizes. Moreover, many authors use no crossvalidation and simply perform a single arbitrary split of their data into training and test sets to obtain their accuracy results. Obviously, one cannot generalize or draw definite conclusion from such efforts, and comparisons between works cannot be made other than in general terms. In this respect, it can only be concluded from our results that the DWTGabor for feature extraction is effective for obtaining high image classification accuracy by an SVM and that it may outperform other feature extraction and classification techniques reported in the literature, at least those based on DWTonly image decomposition. Unfortunately, a more definite conclusion is impossible without gaining access to the image databases used by the other authors.
 
Correct classification rate. 
5. Computational Complexity
Finally, the computational complexity of the DWT, Gabor, contourlet, and curvelet for an image is, respectively, , with being the width of Gabor (Gaussian) mask filter, , and . As a result, the computational complexity of the combination of the DWT and Gabor filter is . In terms of features extraction processing time, the average time required to process a brain, a mammogram, and a retina image with the DWT approach (DWTGabor) was, respectively, 0.19 (0.31), 0.17 (0.32), and 0.15 seconds (0.35) using Matlab R2009a on a 1.5 GHz Core2 Duo processor.
6. Conclusion
We proposed a supervised system for biomedical images classification that uses statistical features obtained from the combination of the discrete wavelet transform and Gabor filter to classify normal images versus cancer images, using support vector machines as classifiers. Our experimental results show that such a hybrid processing model achieves higher accuracy in comparison to using DWT or Gabor filter banks alone. Therefore, the proposed image processing and features extraction approach seem to be very promising for the detection of certain pathologies in biomedical images.
For future works, it is recommended to consider a larger set of features and a selection process to identify the most discriminant ones. In addition, the Gabor parameters will be adjusted for each type of image separately to improve the accuracy. Furthermore, the DWTGabor will be directly compared to the dualtree complex wavelet, curvelet, and contourlet using the same databases and images in order to draw general conclusions. Also, multilabels classifications will be considered in future works to investigate the discriminative power of our approach for each type of pathology. Finally, more experiments on the effect of kernel choice and its parameter on classification accuracy will be investigated.
References
 A. Khademi and S. Krishnan, “Shiftinvariant discrete wavelet transform analysis for retinal image classification,” Medical and Biological Engineering and Computing, vol. 45, no. 12, pp. 1211–1222, 2007. View at: Publisher Site  Google Scholar
 N. Lee, A. F. Laine, and T. R. Smith, “Learning nonhomogenous textures and the unlearning problem with application to drusen detection in retinal images,” in Proceedings of the 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI '08), pp. 1215–1218, Paris, France, May 2008. View at: Publisher Site  Google Scholar
 A. Dong and B. Wang, “Feature selection and analysis on mammogram classification,” in Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM '09), pp. 731–735, Victoria, BC, Canada, August 2009. View at: Publisher Site  Google Scholar
 A. Tirtajaya and D. D. Santika, “Classification of microcalcification using dualtree complex wavelet transform and support vector machine,” in Proceedings of the 2nd International Conference on Advances in Computing, Control and Telecommunication Technologies (ACT '10), pp. 164–166, Jakarta, Indonesia, December 2010. View at: Publisher Site  Google Scholar
 F. Moayedi, Z. Azimifar, R. Boostani, and S. Katebi, “Contourletbased mammography mass classification using the SVM family,” Computers in Biology and Medicine, vol. 40, no. 4, pp. 373–383, 2010. View at: Publisher Site  Google Scholar
 S. Chaplot, L. M. Patnaik, and N. R. Jagannathan, “Classification of magnetic resonance brain images using wavelets as input to support vector machine and neural network,” Biomedical Signal Processing and Control, vol. 1, no. 1, pp. 86–92, 2006. View at: Publisher Site  Google Scholar
 Y. Zhang, S. Wang, and L. Wu, “A novel method for magnetic resonance brain image classification based on adaptive chaotic PSO,” Progress in Electromagnetics Research, vol. 109, pp. 325–343, 2010. View at: Google Scholar
 Y. Zhang, Z. Dong, L. Wu, and S. Wang, “A hybrid method for MRI brain image classification,” Expert Systems with Applications, vol. 38, no. 8, pp. 10049–10053, 2011. View at: Publisher Site  Google Scholar
 M. E. Celebi, H. Iyatomi, G. Schaefer, and W. V. Stoecker, “Lesion border detection in dermoscopy images,” Computerized Medical Imaging and Graphics, vol. 33, no. 2, pp. 148–153, 2009. View at: Publisher Site  Google Scholar
 Q. Abbas, M. E. Celebi, and I. F. García, “Skin tumor area extraction using an improved dynamic programming approach,” Skin Research and Technology, vol. 18, pp. 133–142, 2012. View at: Publisher Site  Google Scholar
 Q. Li, F. Li, and K. Doi, “Computerized detection of lung nodules in thinsection CT images by use of selective enhancement filters and an automated rulebased classifier,” Academic Radiology, vol. 15, no. 2, pp. 165–175, 2008. View at: Publisher Site  Google Scholar
 A. ElBazl, M. Nitzken, E. Vanbogaertl, G. Gimel'jarb, R. Falfi, and M. Abo ElGhar, “A novel shapedbased diagnostic approach for early diagnosis of lung nodules,” in Proceedings of the IEEE International Symposium in Biomedical Imaging (ISBI '11), pp. 137–140, Chicago, Ill, USA, 2011. View at: Google Scholar
 M. T. Coimbra and J. P. S. Cunha, “MPEG7 visual descriptors—contributions for automated feature extraction in capsule endoscopy,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 16, no. 5, pp. 628–636, 2006. View at: Publisher Site  Google Scholar
 B. Li and M. Q. H. Meng, “Texture analysis for ulcer detection in capsule endoscopy images,” Image and Vision Computing, vol. 27, no. 9, pp. 1336–1342, 2009. View at: Publisher Site  Google Scholar
 C. K. Chui, An Introduction to Wavelets, Academic Press, San Diego, Calif, USA, 1992.
 M. Vetterli and C. Herley, “Wavelets and filter banks: theory and design,” IEEE Transactions on Signal Processing, vol. 40, no. 9, pp. 2207–2232, 1992. View at: Publisher Site  Google Scholar
 J. G. Daugman, “Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by twodimensional visual cortical filters,” Journal of the Optical Society of America A, vol. 2, no. 7, pp. 1160–1169, 1985. View at: Google Scholar
 I. W. Selesnick, R. G. Baraniuk, and N. G. Kingsbury, “The dualtree complex wavelet transform,” IEEE Signal Processing Magazine, vol. 22, no. 6, pp. 123–151, 2005. View at: Publisher Site  Google Scholar
 E. Candès and D. Donoho, “Ridgelets: a key to higherdimensional intermittency?” Philosophical Transactions of the London Royal Society, vol. 357, pp. 2495–2509, 1999. View at: Google Scholar
 E. J. Candès and D. L. Donoho, “Continuous curvelet transform—I. Resolution of the wavefront set,” Applied and Computational Harmonic Analysis, vol. 19, no. 2, pp. 162–197, 2005. View at: Publisher Site  Google Scholar
 M. N. Do and M. Vetterli, “The contourlet transform: an efficient directional multiresolution image representation,” IEEE Transactions on Image Processing, vol. 14, no. 12, pp. 2091–2106, 2005. View at: Publisher Site  Google Scholar
 R. J. Ferrari, R. M. Rangayyan, J. E. L. Desautels, and A. F. Frère, “Analysis of asymmetry in mammograms via directional filtering with Gabor wavelets,” IEEE Transactions on Medical Imaging, vol. 20, no. 9, pp. 953–964, 2001. View at: Publisher Site  Google Scholar
 Z. Cui and G. Zhang, “A novel medical image dynamic fuzzy classification model based on ridgelet transform,” Journal of Software, vol. 5, no. 5, pp. 458–465, 2010. View at: Publisher Site  Google Scholar
 T. Gebäck and P. Koumoutsakos, “Edge detection in microscopy images using curvelets,” BMC Bioinformatics, vol. 10, article 75, 2009. View at: Publisher Site  Google Scholar
 J. Ma and G. Plonka, “The curvelet transform: a review of recent applications,” IEEE Signal Processing Magazine, vol. 27, no. 2, pp. 118–133, 2010. View at: Publisher Site  Google Scholar
 N. Kingsbury, “Complex wavelets and shift invariance,” in Proceedings of the IEEE Seminar on TimeScale and TimeFrequency Analysis and Applications, pp. 501–510, London, UK, 2000. View at: Google Scholar
 Y. L. Qiao, C. Y. Song, and C. H. Zhao, “Mband ridgelet transform based texture classification,” Pattern Recognition Letters, vol. 31, no. 3, pp. 244–249, 2010. View at: Publisher Site  Google Scholar
 F. Gómez and E. Romero, “Texture characterization using a curvelet based descriptor,” Lecture Notes in Computer Science, vol. 5856, pp. 113–120, 2009. View at: Publisher Site  Google Scholar
 H. Shan and J. Ma, “Curveletbased geodesic snakes for image segmentation with multiple objects,” Pattern Recognition Letters, vol. 31, no. 5, pp. 355–360, 2010. View at: Publisher Site  Google Scholar
 R. Eslami and H. Radha, “New image transforms using hybrid wavelets and directional filter banks: analysis and design,” in Proceedings of the IEEE International Conference on Image Processing (ICIP '05), pp. 733–736, Genova, Italy, September 2005. View at: Publisher Site  Google Scholar
 O. O. V. Villegas and V. G. C. Sánchez, “The wavelet based contourlet transform and its application to feature preserving image coding,” Lecture Notes in Computer Science, vol. 4827, pp. 590–600, 2007. View at: Google Scholar
 S. Lahmir and M. Boukadoum, “Classification of brain MRI using the LH and HL wavelet transform subbands,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '11), pp. 1025–1028, Rio de Janeiro, Brazil, May 2009 2011. View at: Google Scholar
 S. Lahmir and M. Boukadoum, “Brain MRI classification using an ensemble system and LH and HL wavelet Subbands Features,” in Proceedings of the IEEE Symposium Series on Computational Intelligence (SSCI '11), pp. 1–7, Paris, France, April 2011. View at: Google Scholar
 S. Lahmir and M. Boukadoum, “Hybrid Cosine and Radon Transformbased processing for Digital Mammogram Feature Extraction and Classification with SVM,” in Proceedings of the 33rd IEEE Annual International Conference on Engineering in Medecine and Biology Society (EMBS '11), pp. 5104–5107, Boston, Mass, USA, 2011. View at: Google Scholar
 S. Lahmir and M. Boukadoum, “DWT and RTBased Approach for Feature Extraction and classification of Mammograms with SVM,” in Proceedings of the IEEE Biomedical Circuits and Systems Conference (BioCAS '11), pp. 412–415, San Diego, Calif, USA, November 2011. View at: Google Scholar
 V. N. Vapnik, The Nature of Statistical Learning Theory, Springer, 1995.
 S. Lahmiri and M. Boukadoum, “Hybrid discret wavelet transform and Gabor filter banks processing for mammogram features extraction,” in Proceedings of the IEEE New Circuits and Systems (NEWCAS '11), pp. 53–56, Bordeaux, France, June 2011. View at: Google Scholar
 L. M. Bruce and N. Shanmugam, “Using neural networks with wavelet transforms for an automated mammographic mass classifier,” in Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 985–987, Chicago, Ill, USA, July 2000. View at: Google Scholar
 S. M. H. Jamarani, G. Rezairad, and H. Behnam, “A novel method for breast cancer prognosis using wavelet packet based neural network,” in Proceedings of the 27th Annual International Conference of the Engineering in Medicine and Biology Society (IEEEEMBS '05), pp. 3414–3417, Shanghai, China, September 2005. View at: Google Scholar
 http://medicaldictionary.thefreedictionary.com/circinate+retinopathy.
 C. I. O. Martins, F. N. S. Medeiros, R. M. S. Veras, F. N. Bezerra, and R. M. Cesar Jr., “Evaluation of retinal vessel segmentation methods for microaneurysms detection,” in Proceedings of the IEEE International Conference on Image Processing (ICIP '09), pp. 3365–3368, Cairo, Egypt, November 2009. View at: Publisher Site  Google Scholar
 C. Plant, S. J. Teipel, A. Oswald et al., “Automated detection of brain atrophy patterns based on MRI for the prediction of Alzheimer's disease,” NeuroImage, vol. 50, no. 1, pp. 162–174, 2010. View at: Publisher Site  Google Scholar
 J. Meier, R. Bock, L. G. Nyúl, and G. Michelson, “Eye fundus image processing system for automated glaucoma classification,” in Proceedings of the 52nd Internationales Wissenschaftliches Kolloquium, Technische Universität Ilmenau, 2007. View at: Google Scholar
 E. Sakka, A. Prentza, I. E. Lamprinos, and D. Koutsouris, “Microcalcification detection using multiresolution analysis based on wavelet transform,” in Proceedings of the IEEE International Special Topic Conference on Information Technology in Biomedicine, Ioannina, Greece, October 2006. View at: Google Scholar
 S. G. Mallat, “Theory for multiresolution signal decomposition: the wavelet representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674–693, 1989. View at: Publisher Site  Google Scholar
 J. Suckling, J. Parker, and D. R. Dance, “The mammographic image analysis society digital mammogram database,” in Proceedings of the the 2nd International Workshop on Digital Mammography, A. G. Gale, S. M. Astley, D. D. Dance, and A. Y. Cairns, Eds., pp. 375–378, Elsevier, York, UK, 1994. View at: Google Scholar
 H. J. Chiou, C. Y. Chen, T. C. Liu et al., “Computeraided diagnosis of peripheral soft tissue masses based on ultrasound imaging,” Computerized Medical Imaging and Graphics, vol. 33, no. 5, pp. 408–413, 2009. View at: Publisher Site  Google Scholar
 J. K. Kim, J. M. Park, K. S. Song, and H. W. Park, “Adaptive mammographic image enhancement using first derivative and local statistics,” IEEE Transactions on Medical Imaging, vol. 16, no. 5, pp. 495–502, 1997. View at: Google Scholar
 H. S. Sheshadri and A. Kandaswamy, “Breast tissue classification using statistical feature extraction of mammograms,” Medical Imaging and Information Sciences, vol. 23, no. 3, pp. 105–107, 2006. View at: Google Scholar
 N. Cristianini and J. ShaweTaylor, Introduction to Support Vector Machines and Other KernelBased Learning Methods, Cambridge University Press, Cambridge, UK, 2000.
 L. Chen, X. Mao, Y. Xue, and L. L. Cheng, “Speech emotion recognition: features and classification models,” Digital Signal Processing, vol. 22, pp. 1154–1160, 2012. View at: Google Scholar
 F. Palmieri, U. Fiore, A. Castiglione, and A. De Santis, “On the detection of cardsharing traffic through wavelet analysis and Support Vector Machines,” Applied Soft Computing, vol. 13, no. 1, pp. 615–627, 2013. View at: Google Scholar
 A. Azadeh, M. Saberi, A. Kazem, V. Ebrahimipour, A. Nourmohammadzadeh, and Z. Saberi, “A flexible algorithm for fault diagnosis in a centrifugal pump with corrupted data and noise based on ANN and support vector machine with hyperparameters optimization,” Applied Soft Computing, vol. 13, no. 3, pp. 1478–1485, 2013. View at: Google Scholar
 R. J. Martis, U. R. Acharya, K. M. Mandana, A. K. Ray, and C. Chakraborty, “Cardiac decision making using higher order spectra,” Biomedical Signal Processing and Control, vol. 8, pp. 193–203, 2013. View at: Google Scholar
 M. R. Mohammad, “Chisquare distance kernel of the gaits for the diagnosis of Parkinson’s disease,” Biomedical Signal Processing and Control, vol. 8, pp. 66–70, 2013. View at: Google Scholar
 R. Vandenberghe, N. Nelissen, E. Salmon et al., “Binary classification of 18Fflutemetamol PET using machine learning: comparison with visual reads and structural MRI,” NeuroImage, vol. 64, no. 1, pp. 517–525, 2013. View at: Google Scholar
 http://marathon.csee.usf.edu/Mammography/Database.html.
 http://www.ces.clemson.edu/~ahoover/stare/.
 http://www.med.harvard.edu/aanlib/.
Copyright
Copyright © 2013 Salim Lahmiri and Mounir Boukadoum. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.