Abstract

The speckle noise is inherent to transthoracic echocardiographic images. A standard noise-free reference echocardiographic image does not exist. The evaluation of filters based on the traditional parameters such as peak signal-to-noise ratio, mean square error, and structural similarity index may not reflect the true filter performance on echocardiographic images. Therefore, the performance of despeckling can be evaluated using blind assessment metrics like the speckle suppression index, speckle suppression and mean preservation index (SMPI), and beta metric. The need for noise-free reference image is overcome using these three parameters. This paper presents a comprehensive analysis and evaluation of eleven types of despeckling filters for echocardiographic images in terms of blind and traditional performance parameters along with clinical validation. The noise is effectively suppressed using the logarithmic neighborhood shrinkage (NeighShrink) embedded with Stein’s unbiased risk estimation (SURE). The SMPI is three times more effective compared to the wavelet based generalized likelihood estimation approach. The quantitative evaluation and clinical validation reveal that the filters such as the nonlocal mean, posterior sampling based Bayesian estimation, hybrid median, and probabilistic patch based filters are acceptable whereas median, anisotropic diffusion, fuzzy, and Ripplet nonlinear approximation filters have limited applications for echocardiographic images.

1. Introduction

Echocardiography is commonly used in the diagnosis of valvular regurgitation and stenosis. It is a noninvasive, safe, and a less expensive technique; but the low contrast, shadowing, and the speckle noise present make it hard for a clinician to read. The noise masks the finer clinical detail present in the image and thereby reduces the human visual ability for detecting the abnormalities. It reduces the potentiality of images in providing crucial and vital information [1]. The interpretation and clinical conclusions largely depend on the image quality and the experience of the cardiologist [1, 2]. Hence, it is necessary to suppress speckle noise without altering the fine details from the transthoracic echocardiographic (TTE) images.

Filtering techniques based on the concepts such as wavelet [1, 36], anisotropic diffusion (AD) [1, 4, 5], a priori statistical information [1, 4, 7, 8], multiresolution [913], nonlocal means (NLM) [4, 14, 15], total variation (TV) [1618], bilateral [19, 20], median [57], Wiener [5, 13], geometric [1, 5], local statistics [5], and fuzzy [21] filters have been advocated for noise reduction in ultrasound images. Various filtering techniques and performance parameters used by researchers are tabulated in Table 1. Most of the researchers have employed standard full-reference based metrics such as peak signal-to-noise ratio (PSNR), mean square error (MSE), structural similarity (SSIM) index, contrast-to-noise ratio (CNR), and root mean square error (RMSE), tabulated in Table 1, for evaluating the filter performance.

These full-reference parameters evaluate the filter performance considering the output processed and the standard noise-free image. But, unfortunately, the noise-free reference image does not exist for echocardiographic images. Hence, these traditional parameters do not reflect the true performance in case of the echocardiographic images. The possible solution to this problem would be to use parameters such as speckle suppression index (SSI) [7, 8], speckle suppression and mean preservation index (SMPI) [7, 8], and beta metric (β) [6, 21]. These are blind source based parameters which do not need a standard noise-free reference image for estimating filter performance. The speckle noise present in echocardiographic images is multiplicative in nature. This noise masks the finer details necessary for abnormality diagnosis. Many filters result in image smoothing thereby suppressing the finer details. Hence, it would be necessary to know those of the filters which can suppress the noise while preserving the finer details.

Mateo and Fernández-Caballero [6] and Biradar et al. [21] employed beta metrics (β) to evaluate edge preservation. Iqbal et al. [8] used SSI and SMPI to measure amount of speckle suppression and edge preservation index (EPI) for estimating edge preservation in synthetic aperture radar (SAR) images. This paper evaluates the performance of eleven types of filters based on SSI, SMPI, β, figure of merit (FoM), and image quality index (IQI) and eleven other parameters along with the visual quality assessment and clinical validation. A list of filters types and their constituent approaches is tabulated in Table 2 for quick reference.

2. Materials and Methods

The speckle is a multiplicative and locally correlated noise. The speckle noise stems from point scatterers in a homogenous tissue, which cannot be resolved by the ultrasound machine. The point scatterers, which are much smaller than the ultrasound wavelength, scatter the wave. Two or more waves travelling towards the scanning probe from such scatterers may interfere with each other, constructively or destructively, creating bright and dark spots, which are commonly known as speckles. For interference, the backscattered signal from the scatterers should overlap in time and space. This happens when the distance between them is within the point spread function (PSF) support. It is important to note that the typical size of the speckle is similar to the PSF support. As the PSF changes with depth, the statistics of speckle noise are space (depth)-variant. To find a clean approximation of the spatial reflectance distribution, the point spread function (PSF) of the imaging system is being estimated. The noisy degraded images create a problem for clinicians to discriminate fine details of the image during diagnosis. The speckle fluctuations would be proportional in magnitude to signal strength and the resultant image will have significant noise even in the bright sections of the image. The noise is modeled aswhere is the original noisy image, is the noise-free image, is the multiplicative noise, and is the pixel locations in each of the images [3, 6, 9]. The variables and are the spatial pixel locations. The multiplicative noise is converted into approximate additive noise by applying logarithmic transformation on both sides of (1):Equation (2) can be rewritten as , where , , and .

2.1. Despeckling Filters

Loizou et al. [5, 22] compared applications of 10 despeckling filters for suppression of speckle noise in US images of carotid artery. This paper studies the applications of despeckling filters (DsFs) considered by Loizou et al. [5, 22] for TTE images. The despeckling filter based on the mean and the variance of the neighborhood is abbreviated as DsFlsmv where DsF stands for despeckling filter and ls, m, and v represent local statistics, mean, and variance, respectively.

The output of first-order local statistics filter is given by where is the local mean, give the estimated denoised pixel values in the window, and is the weighing factor [5, 22], where The weighing factor used in DsFlsmv filter is defined as where is the variance of the moving window, is the ratio between variance and mean computed on the whole image, and with and as the variance and the mean of noise selected in the window [5, 22]. The homogenous mask area filtering technique is abbreviated as DsFlsminsc filter (DsF-local statistics minimum speckle index). It works on the most homogeneous 5 × 5 neighborhood around each pixel using a subset of 3 × 3 window. The Wiener filter is based on the mean square error and it is abbreviated as DsFwiener [5, 22]. The weight factor of DsFwiener filter is given byThe filter based on the estimation of maximum homogeneity over a pixel neighborhood is called the DsFhomog filter. This filter estimates the homogeneous neighborhood around every pixel by taking into account pixels belonging to the processed neighborhood. The hybrid median is abbreviated as DsFhmedian (despeckling filter-hybrid median). It is an extension of DsFmedian (despeckling filter-median). The median values are calculated using three different windows, namely, normal shape, x-shape, and cross shape [5, 22].

2.2. Synthetic Aperture Radar (SAR) Filters

The standard adaptive SAR filtering techniques such as those of Lee, Kuan et al., and Frost et al. are analyzed in this paper [1, 7, 8, 23]. The formulations of Lee and Kuan et al.’s filter are similar but with different weighting function. In Frost et al.’s filter, the noise-free image is being computed by convolving the original noisy image with a mask.

2.3. Fast Bilateral Filter

The nonlinear characteristics of range filter in the bilateral filter increase the computational load. An improvement in the performance can be achieved using the raised cosine kernels. The generalized form of the filter based on the raised cosine kernel is given bywith , where is the coefficient of trigonometric function, is kernel degree, and and represent the auxiliary images and range kernel.

2.4. Fuzzy Filter

The fuzzy filters based on the triangular function with median (TMED) center, asymmetrical triangular function with median (ATMED), triangular moving average (TMAV) center, and asymmetrical triangular moving average (ATMAV) are analyzed in the logarithmic domain in this paper. The output of the fuzzy filter is given by where are the window functions based on TMED, ATMED, TMAV, or ATMAV and is the area [21, 24]. All the four logarithmic fuzzy filters are combined with Wiener filter and are known as hybrid fuzzy filters. The performances of hybrid fuzzy filters are further improved by embedding modified geometric filter. The filters are abbreviated as the GWF filters where G stands for geometric, W stands for Wiener, and F stands for fuzzy filters [21, 24].

2.5. Fourier Filtering

The images are transformed from the spatial domain to the frequency domain and vice versa in Fourier filters. Fourier Butterworth filter (FBF) reduces the noise with the edges preserved. The homomorphic Fourier ideal filter (HFIF) and the homomorphic Fourier Butterworth filter (HFBF) are implemented by projecting the input image into the logarithmic space, applying the fast Fourier transformations, filtering the image using ideal or Butterworth filter, followed by inverse FFT transformations, and projecting the image back into the nonlogarithmic space [6].

2.6. Wavelet Shrinkage Techniques

The wavelet shrinkage techniques can be used in despeckling applications by operating in the logarithmic domain. The input is projected into logarithmic space, subjected to denoising, and projected back to the nonlogarithmic space. This procedure can be mathematically represented as , where are the wavelet shrinkage techniques [2529]. During the implementation of wavelet shrinkage in the logarithmic domain, it is assumed that the noise variance is known, so that the focal point of discussion would be on the evaluation of the filter itself. The Bayes thresholding approach is a data driven subband adaptive wavelet shrinkage technique [25]. The concept of the multiscale product thresholding (MPT) is based on the idea that multiplications of the discrete wavelet transform (DWT) at adjacent scales enhance the edges and effectively suppress the noise [27]. In logarithmic probability shrinkage (ProbShrink) filtering method, the wavelet coefficients are multiplied with the estimated probability of the signal [21, 30]. In SURELET [29], the pointwise thresholding is performed based on the minimization of SURE and LET. The interscale orthonormal wavelet thresholding (IOWT) is a parameterized denoising technique which alleviates the necessity of a statistical design model [26]. The limitations of block thresholding are overcome by incorporating SURE with NeighShrink resulting in NeighShrinkSURE (NSS) [28]. The details subbands are extracted and subband thresholding is reinforced with calculation of the optimal threshold and neighborhood size followed by thresholding using NeighShrink.

2.7. Multiresolution Techniques

Some of the multiresolution based filtering techniques such as M-band ridgelet (MBR) [9, 21], Ripplet nonlinear approximation (RNLA) [11, 12], generalized likelihood estimation method (GLM) [1, 4, 13], and posterior sampling based Bayesian estimation (PSBE) [10] are considered in this paper for performance evaluation. The combination of M-band wavelet and ridgelet is known as M-band ridgelet (MBR). The texture is preserved using MBR filter [9, 21]. In the GLM based filter, an initial classification of the coefficients is carried out based on the correlation among the prominent features across various resolution scales noniteratively. The initial classification is employed for the estimation of statistical distribution of the features of interest [1, 4, 13]. In the logarithmic PSBE, noise-free image details are estimated using Bayesian least square error calculations using conditional posterior sampling and then the average square error is minimized [10]. The generalization of curvelets known as Ripplet transforms is being achieved by incorporating support and degree parameters [11, 12]. The Ripplet transformation in discrete domain is defined as where the Ripplet coefficients are represented by [11, 12].

2.8. Total Variation (TV) Based Filters

The TV based denoising is based on the concept that the integral of absolute gradient of the noisy images would be high resulting in high total variation [18]. Let be a noisy image; the denoised image can be obtained by minimizing the quadratic term with the TV regularization given by where the quadratic data term fits in according to the least square fit, is the regularization term (denoising function), and is the weighting parameter which is the measure of smoothness. The fidelity term controls the amount of denoising by measuring local variance in the image in adaptive fidelity based TV (AFTV) [16]. Anisotropic TV (ATV) is based on split Bregman algorithm. The Bregman iterations are employed during the denoising process [17].

2.9. Anisotropic Diffusion (AD) Based Filters

The AD is a nonlinear partial differential equation (PDE) based filtering technique that promotes diffusion in the homogeneous regions while holding back at edges [1, 31]. In speckle reducing anisotropic diffusion (SRAD) filter, the diffusion function is controlled by instantaneous coefficient of variation (ICOV) [1, 32]. The diffusion function employed in SRAD is of the form represented in where stands for the “speckle scale function.” The coherence enhancing diffusion (CED) employs structure tensor matrix for analyzing the local distribution of gradient vector [1, 33]. Detail preserving anisotropic diffusion (DPAD) method estimates equivalence between threshold controlling the level of diffusion and variation in noise coefficient by incorporating modifications to the SRAD filter [4, 34].

2.10. Geometric Filter

The geometric filter works with an assumption that the images are made up of the valleys and the narrow walls. An intensity of pixel located at the center of a 3 × 3 window is compared with eight neighbors. Depending on the intensity values of the neighborhood pixels, the value is either incremented or decremented so that the values stand out in comparison with the intensity value in the neighborhood [1, 35].

2.11. Nonlocal Mean Filter

The nonlocal means approach of denoising is governed by the patches around each pixel. The redundant information in the image is being used in optimized Bayesian nonlocal means (OBNLM) [4, 14]. The patterns surrounding each pixel are compared instead of the intensity. In NLM based denoising, the Euclidean distance is computed between the patches. The generalization of this distance was advocated using probabilistic patch based (PPB) method [15]. The weight in probabilistic patch based (PPB) filter between patch and patch with number of iterations is defined as where trade-off between noise suppression and fidelity estimation is achieved through parameters and ; and are the th pixel amplitude, where their previous values are and for patches and , respectively.

3. Evaluation of Despeckling Filters

The despeckling filters are analyzed and evaluated for the clinical TTE images. These images are noisy; no noise-free reference image is available. Therefore, the evaluation of filters is carried out using the original speckled input. The analysis of performance is based on the blind assessment and the full-reference based image quality metrics. The blind assessment parameters such as the SSI [7, 8], SMPI [7, 8], and β [6, 21] are used in performance evaluation. These parameters assess the performance based on the original noisy image and the denoised images. The parameters such as the SSIM, IQI, and FoM [1, 4, 21] are used for measuring overall image quality, structure, and edge preservation. The traditional parameters such as PSNR, MSE, SNR, LMSE, RMSE, average difference, and maximum difference (MD) are also being computed using original TTE images. The traditional parameters may not reflect the true performance of the filters on real clinical images; therefore, the evaluation of performance is being validated by the practicing clinicians. All the experiments are implemented using MATLAB R2008a. The source codes provided by the authors of various papers are also being used with proper selection of parameters [5, 11, 1317, 20, 2530].

3.1. Clinical Echocardiographic Images

The despeckling filters are applied to clinical database consisting of the TTE images of aortic valve and cardiac chambers. The database consists of images acquired in parasternal long axis (PLAX), parasternal short axis (PSAX), apical five-chamber (A5C), apical four-chamber (A4C), and apical two-chamber (A2C) views. The TTE image database was completely anonymized, with patient information provided. A total of 1000 images acquired from 20 patients in 5 views and 2 windows are used to evaluate and analyze the performance of despeckling filters.

3.2. Image Quality Metrics

The parameters such as the SNR, PSNR, MSE, correlation coefficient (), RMSE, SC, LMSE, MD, Err3, Err4, NAE, NCC, and SSIM are computed using noisy and noise-free images [5, 22]. Some of the performance parameters are defined below:where , ,where is the scalar multiplier being utilized as penalization factor with typical value 1/9, and are the number of pixels in original and processed images, respectively, is the Euclidean distance, and represent the filtered version of original and processed images, and pixel mean intensities in the region and are represented by and , respectively [1, 68].

4. Results

The parameters being used in the implementation of filters are tabulated in Table 3. The results are being tabulated for each type of filter so that performance can be analyzed for intra- and interfilter type. The values of image quality metrics obtained on application of various filters are tabulated in Tables 46. The results for wavelet shrinkage and multiresolution techniques are tabulated in Table 4. The experimental results for despeckling, Fourier, and SAR filters are tabulated in Table 5.

Wavelet Shrinkage Techniques. The wavelet shrinkage techniques such as the MPT, BayesShrink, OWT, BlockShrink, SURELET, and NSS result in better texture preservation compared to SAR filters. Wavelet soft thresholding is inferior in terms of β and SMPI. Maximum speckle noise is suppressed using DB45 and DMEY mother wavelets. The values of SMPI are very high (≤40) suggesting that speckle is not suppressed using wavelet soft thresholding. All the wavelet soft shrinkage techniques result in FoM value in the range of 0.4 to 0.8. computed for soft thresholding is <0.01 reflecting the loss of edge information.

The noise is suppressed effectively using log NSS filter. The log NSS filter and the ProbShrink (PS) filter result in the best values of SSI among the multiscale techniques. The IOWT based denoising results in SSI ≥1.1 which suggests that the speckle noise is not suppressed.

Multiresolution Techniques. The multiresolution filtering techniques such as MBR, RNLA, PSBE, and GLM based filters perform well compared to most of the shrinkage techniques. The GLM based filtering approach is effective in the noise suppression and the edge preservation as reflected by IQI (0.7), β (0.9), FoM (0.9), SMPI (2.5), and SSI (0.99). The logarithmic PSBE and logarithmic MPT filters result in effective noise suppression and edge preservation, similar to the GLM based filter. It is also observed that the SMPI values for PSBE, GLM, RNLA, and MBR are superior in comparison to ProbShrink. The PSBE and GLM based filters result in β to be approximately equal to one.

Despeckling Filtering Techniques. The performances of the DsFlsmv, DsFwiener, DsFmedian, and DsFsrad filter are similar in terms of IQI, FoM, SMPI, and SSI. The SMPI of the DsFgf4d filter is double that of the DsFwiener, DsFmedian, and DsFsrad filter, which reflects its inferiority in terms of speckle suppression. The DsFhomog filter has the SMPI which is almost 4 times higher compared to DsFlsmv and DsFsrad filter. The SSI of all the DsFs (except DsFhomog) is less than one and the DsFls filter has the lowest values. The edges are not preserved using the DsFlsminsc and DsFhomo whereas the DsFlsmv, DsFwiener, and DsFwaveltc filters preserve edges as shown by .

Fourier, SAR, and Fuzzy Filters. The performances of the HFIF and the HFBF filters are superior in comparison to the FIF and FBF filters in terms of SSI. These results in terms of SMPI values are superior by a factor of two compared to SAR filters. FoM is greater than one suggesting better denoising performance. Homomorphic Fourier filters result in smaller value of β compared to Fourier filters. Fourier filters have which speak of edge preservation. The issue of concern is smaller IQI using Fourier based techniques. It is observed that IQI is less than 0.4 using the FIF and FBF filters. The SAR filters oversmooth the texture present in the TTE images. The values of SSI are greater than one using Lee, Kaun et al., and Frost et al.’s filters indicating that speckle noise is not suppressed. The performance of SAR filters is poor in terms of SMPI. The major problems using SAR filters are high values of SMPI and SSI. The fuzzy filters perform well in terms of IQI, FoM, and SSI with fractionally higher SMPI (≤4) but have poor beta metric. The GW filter results in the least SSI value among all the fuzzy and hybrid fuzzy filters. The hybrid fuzzy filters have smaller SMPI compared to logarithmic fuzzy filters. All fuzzy and hybrid fuzzy filters have FoM greater than 0.8. The modified geometric filter preserves the edges as exhibited by .

Total Variation, Diffusion, and Nonlocal Mean Based Filters. The performance of TV based filters is moderate in terms of IQI and SMPI. The AFTV and ATV filters result in poor IQI (≤0.3) and moderate β, FoM, and SMPI. These filters have SSI <1. All the TV filters have FoM greater than 0.8 except for the AFTV filter. Filters such as AFTV and TV have β ≤ 0.5. The output images on application of PPB and NLM filters result in SSI ≤1. The DPAD, FBL, NLM, and PPB filters have SMPI far less compared to SAR filters proving their superior speckle suppression capabilities. The FoM using the DPAD and PPB filters is almost equal to one and is far superior compared to the SAR and OBNLM filters. The IQI is comparatively less using the PPB (0.4), NLM (0.6), and DPAD (0.6) filters whereas FBL (0.7) is fractionally higher.

The performances in terms of IQI, β, FoM, SMPI, SSI, and MD for 1000 TTE images are tabulated in Table 7. The performances of the filters are also evaluated in terms of traditional parameters and the values are tabulated in Table 8. The results are being represented in the form of average plus/minus standard deviation. The DsFwiener, DsFsard, GLM, PPB, GWF, DPAD, and PSBE stand out among the others in Table 8.

Visual Quality Assessment. The visual qualities of denoised A5C TTE image are shown in Figure 1. The blocky effect appears in Lee and Kaun et al.’s filtered images. The SAR filters result in reduction of contrast along with smoothing of the images. Smoothing is also observed on usage of AD, NSS, TV, and ATV filters. The denoised images appear noisy on using filters such as wavelet shrinkage, TMED, ATMED, and GLM filters. The filters such as DsFls, DsFlsminsc, DsFca, HATMAV, FBF, FIF, and AD result in some amount of blurring of the images with loss of the texture information.

Clinical Validation. The clinical validation of preprocessed images is carried out by seeking opinion of four practicing cardiologists at PGI, Chandigarh. One of the authors of this paper is a senior practicing cardiologist, who initially graded the quality of the processed images. The grading of images is based on visual perception of the practicing clinicians. The procedure of grading consisted of awarding a grade value in the range of 1 to 10 where 1 signifies the poor quality of processed image and grade 10 is assigned to the best visual quality image. The analyses of these grades reveal that the filters such as the DsFgf4d, DsFhomog, DsFlsmv, DsFhmedian, DPAD, GLM, PSBE, NLM, and PPB are acceptable whereas DsFhomo, DsFmedian, DsFad, TMED, HTMED, and RNLA filtered images are clinically not suitable.

5. Conclusion

The despeckling applications of eleven types of filters are analyzed in this paper in terms of blind and full-reference parameters. The traditional parameters often fail to reflect the true performance of the filters in the absence of a noise-free reference image. The parameters such as speckle suppression index, speckle suppression and mean preservation index, and beta metric are used to study the speckle suppression and edge preservation capability of each filter. The image quality and structural preservation are analyzed using SMPI, FoM, IQI, and SSI. Various types of benchmark filters are available and it would be very difficult to choose the best clinically acceptable filter. It is also necessary to remove speckle noise but with the edges preserved. The major contributions of this paper are as follows: it helps in selecting the best filters suitable for clinical TTE images among eleven types of filters and their constituents, it studies and evaluates the performance in terms of blind and full-reference based parameters, and evaluations of filters based image quality metrics are validated by practicing clinicians. Based on the quantitative evaluation and clinical validation, it is concluded that the performances of DsFgf4d, DsFhomog, DsFlsmv, DsFhmedian, DPAD, GLM, PSBE, NLM, and PPB filters are acceptable.

Ethical Approval

All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with Helsinki Declaration of 1975, as revised in 2000.

Informed consent was obtained from all patients for being included in the study.

Competing Interests

The authors declare that they have no competing interests.