Abstract
Impulsive noise removal usually employs median filtering, switching median filtering, the total variation method, and variants. These approaches however often introduce excessive smoothing and can result in extensive visual feature blurring and thus are suitable only for images with low density noise. A new method to remove noise is proposed in this paper to overcome this limitation, which divides pixels into different categories based on different noise characteristics. If an image is corrupted by salt-and-pepper noise, the pixels are divided into corrupted and noise-free; if the image is corrupted by random valued impulses, the pixels are divided into corrupted, noise-free, and possibly corrupted. Pixels falling into different categories are processed differently. If a pixel is corrupted, modified total variation diffusion is applied; if the pixel is possibly corrupted, weighted total variation diffusion is applied; otherwise, the pixel is left unchanged. Experimental results show that the proposed method is robust to different noise strengths and suitable for different images, with strong noise removal capability as shown by PSNR/SSIM results as well as the visual quality of restored images.
1. Introduction
Images often contain impulsive noise, which may arise from transmission errors, malfunctioning camera photo sensors, optic imperfections, or poor illumination. The sources of image disturbances include lightning, strong electromagnetic interferences caused by faulty high voltage powerline insulation, car starters, and unprotected electric switches. These noise sources generate short high-energy pulses. As a result, corrupted images contain sparsely occurring isolated pixels, for example, white and black points, and grayscale points that differ significantly from their neighbors.
Reducing such noise is critical in many applications, such as pattern recognition, image identification, and image fusion. Noise-free medical images can significantly assist in the diagnosis of a disease; for example, imaging systems can detect metabolic changes in the hippocampus of Alzheimer’s disease patients, when assessing the risk of dementia. Various methods have been proposed over the past several decades to produce clean images from noisy versions.
The simple and direct methods are the median (MED) filter [1] and its variants. A MED filter replaces every observed pixel with the median pixel within its neighborhood; this neighborhood is also called sliding window. MED and MED variants output a median pixel but there are differences between them. The Adaptive Median Filter (AMF) [2] adopts a dynamic sliding window whose size depends adaptively on local noise density. The Weighted Median Filter (WMF) [3] employs a weighted adjustment window that differentially duplicates the pixels within a current window. The Center-Weighted Median Filter (CWMF) [4], in contrast, considers the number of copies and sets the largest number for the center pixel. The Adaptive Center-Weighted Median Filter (ACWMF) [5] combines the AMF and CWMF techniques. These median filtering (MF) methods introduce too much smoothing and blur visual features extensively. Moreover, they are only suited to low density noise; these methods do not make a distinction between noisy pixels and noise-free pixels.
Apart from MF, there is another family of methods termed switching filtering (SF). Different from MF, SF makes a distinction between noisy pixels and noise-free pixels, containing a detection and a removal module. The former identifies the noisy pixels; the latter applies an algorithm to corrupted pixels to obtain an estimate of the noise-free pixels. In SF, impulse detection is the core technique. If the detection module fails to identify corrupted pixels, they will be left unchanged, resulting in poor restoration image. If the detection module correctly classifies a noisy pixel but also identifies noise-free pixels as noisy, much of the image details will be lost. Therefore, accurate and complete identification determines the quality of filtered images.
Currently, many methods are used to identify impulses. Three ways are summarized. The first compares a noisy image with an estimate of its noise-free image pixel by pixel. If the absolute difference of paired pixels is larger than a predefined threshold, the corresponding pixel is declared as corrupted; otherwise, it is declared as noise-free. To obtain an estimate of the noise-free image, a median and weighted median-based impulse detector is devised in [6]; the ACWMF is used in [7]; an improved ACWMF is proposed in [8] where if the noise density is larger than 30%, the sliding window shape of the IACWMF is changed; otherwise, it reverts to ACWMF; a nonlocal median filter is utilized in [9]; a spatial inverse filter is employed in [10]. Estimation of a noise-free pixel determines whether the pixel is corrupted, not the final output. The second method to identify impulses exploits the local neighborhood to design detectors statistically, for example, the Rank-Ordered Absolute Differences (ROAD) [11], the Directional Absolute Relative Differences (DARD) [12], and using the first eight minimum aggregated intensities of the pixels within a sliding window that contains twenty-five pixels [13]. The third method uses artificial intelligence techniques, such as an Artificial Neural Network (ANN) [14], Neurofuzzy Network (NFN) [15], or Support Vector Machine (SVM) [16].
Apart from MF and SF, variational and partial differential equations use a variational energy minimization model to obtain a solution. One of these is the Rudin-Osher-Fatemi (ROF) model proposed by Rudin et al. for edge-preserving image restoration [17]. However, ROF method exhibits staircase effects in restored images [18]. To avoid such artifacts, various modified methods have been developed such as adaptive or weighted total variation regularization [19, 20]. Despite their usefulness, the methods usually do not work with high density noise because they treat corrupted and uncorrupted pixels uniformly.
Inspired by switching filtering and variational methods, in this paper, a new method is proposed to reduce impulsive noise consisting of two schemes. One is for the salt-and-pepper nose model, and the other is for the random valued impulse model. In the first scheme, pixels are divided into corrupted and uncorrupted. The modified total variation diffusion is only applied on the corrupted pixels while the uncorrupted pixels are left unchanged. In the second scheme, the pixels are divided into corrupted, uncorrupted, and possibly corrupted. For corrupted pixels, modified total variation diffusion is used to cope with them; for possibly corrupted pixels, weighted total variation diffusion is used; and uncorrupted pixels are left unchanged. Experimental results show that the proposed method is extremely effective not only for salt-and-pepper noise but also for random valued impulses and is well suited for the medical and biomedical imaging fields such as [21, 22].
Our Contributions. In this work, we propose a new method to reduce impulsive noise for grayscale images. The five main contributions are as follows:(i)A fast and efficient statistical detector is proposed to identify salt-and-pepper noise. When the intensity of a current pixel is 0 or 255, the detector works out the number of the pixels within the current neighborhood, such that each pixel must satisfy the condition that the absolute difference between it and the current pixel is larger than a predefined threshold. If the number is larger than 3, the current pixel is declared as corrupted; otherwise, it is a noise-free pixel. This detection method is very effective despite its simplicity.(ii)Pixels are divided into categories based on different noise characteristics. If an image is corrupted by salt-and-pepper noise, the pixels are divided into corrupted and noise-free; if the image is corrupted by randomly valued impulses, the pixels are divided into corrupted, noise-free, and possibly corrupted.(iii)Pixels falling into different categories are processed differently. If a pixel is declared as corrupted, modified total variation diffusion is applied; if the pixel is declared as possibly corrupted, weighted total variation diffusion is applied; otherwise, the pixel is left unchanged.(iv)An accelerated scheme is proposed for the salt-and-pepper noise model that replaces the initialization noisy image with an evolved intermediate image obtained by a new mean filter. The accelerated scheme significantly decreases the number of iterations.(v)The proposed method is robust to different noise strengths and images, with a strong noise removal capability. Experiments show that, for salt-and-pepper noise model, denoising results obtained by the proposed method significantly outperform those obtained by the MED filter [1] and the common Switching Median Filter (SMF) [6]; the proposed method also outperforms the results obtained by the Spectral Gradient Method (SGM) [7]. In the random valued impulse model, denoising results obtained by the proposed method significantly outperform the traditional total variation diffusion (TVD) and the New Selective Degenerate Diffusion (NSDD) [23] method.
Organization. The rest of the paper is organized as follows. In Section 2, eight existing diffusion methods are introduced. Section 3 describes the details of noise removal. Experimental results and comparisons are formulated in Section 4. And conclusions are drawn in Section 5.
2. Existing Diffusion Methods
Diffusion is an approach to image denoising. Let be an image intensity function, c be a spatially varying diffusion coefficient, be the time step, and and denote divergence and gradient operators, respectively. The universal diffusion framework isBased on different designs for the diffusion coefficient, many diffusion equations have been proposed. Eight classical diffusivity coefficients are detailed as follows.
Linear Diffusion [24]. Emerging from the heat conduction in physical sciences, linear diffusion is also called heat diffusion. The diffusivity function of it is a constant, which is usually set to 1; that is,The corresponding diffusion equation (or heat equation) is where the symbol is the Laplacian operator. As in [24], linear diffusion is equivalent to a smoothing process with a Gaussian kernel. Therefore, linear diffusion has a drawback similar to Gaussian filtering, which is the uniform filtering of local signal features and noise, and leads to smooth image details.
Perona and Malik Diffusion [25]. PM diffusion is a nonlinear conduction process, where the diffusion can take place with variable conduction in order to control the smoothing effect. There are two kinds of diffusivity functions in PM diffusion, given bywhere the diffusion constant is a gradient modulus threshold that controls the conduction. The diffusion coefficient in PM process is a decreasing function of the gradient of the signal. As can be seen from (4) or (5), the diffusivity function conducts along edges; therefore, the PM diffusion method preserves edges and controls smoothing. Some drawbacks and limitations however are that the diffusivity functions are very sensitive to noise, and further the PM diffusion equation is ill-posed [26].
Total Variation Diffusion. TV diffusion is also a nonlinear conduction process, proposed as a smoothing measurement for images in regularized models. The diffusion coefficient is unbounded asIn the TV process, the diffusivity function prevents edges from diffusing. Therefore, TV diffusion plays an edge-preserving role. Experiments show that it effectively recovers piecewise constant signals [27].
Charbonnier Diffusion. Charbonnier diffusion coefficient employs a half-quadratic function [28]:The diffusion function is well posed because it is strictly convex. Similar to the PM and TV processes, it also preserves edges.
Weickert Diffusion. Weickert diffusion is anisotropic diffusion. It employs a structure tensor to identify features such as corners or measure the local coherence of structures [29]. The specific diffusivity function is In contrast to PM diffusion, Weickert diffusion preserves the boundaries between different regions; however, it usually creates ring artifacts on smooth regions.
FAB Diffusion [30]. Forward-and-backward diffusion is also nonlinear diffusion. The diffusivity function isThis coefficient is locally adjusted according to image features such as edges and textures and can switch the diffusion process from a forward to a backward mode according to a given set of criteria. In this equation, the parameter limits the gradients to be smoothed, while the parameter defines the range of backward diffusion.
NSDD Diffusion [23]. NSDD diffusion method is a modification on the Selective Degenerate Diffusion (SDD), and the acronym NSDD stands for New Selective Degenerate Diffusion. The diffusion flow of it iswhere is the scaling function and is associated with a noise detector; the scaling function of SDD is .
3. The Proposed Noise Removal Method
In this section, the details of the proposed method are introduced. Section 3.1 introduces the salt-and-pepper noise model and the random valued impulse model and their denoising structures. Section 3.2 formulates the noise detection methods. Section 3.3 describes the processing techniques of noise suppression. The acceleration of the proposed method in the salt-and-pepper noise model is discussed in Section 3.4, and the computational complexity in the random valued impulse model is analyzed in Section 3.5.
3.1. Noise Model and Denoising Structure
As mentioned in the Introduction, in this paper, we only focus on impulse noise removal, assuming 8-bit grayscale image representation. Let represent the pixel at the position in an image; a contamination image can be modeled aswhere and denote the original noise-free pixel and the contaminative pixel, respectively. In this model, the intensity of is a random variable. If takes on the value 0 or 255 with equal probability, then it is a salt-and-pepper noise model, denoted by SPM; if takes on any value from the range , , then it is random valued impulse model, denoted by RDM. The corresponding denoising methods associated with the two noise models are introduced in the next subsection.
The denoising structures are shown in Figure 1. As seen in inset (a) in Figure 1, the denoising structure in SPM consists of a noise detection module, a noise removal module, and an acceleration module. In the noise detection stage, a detector is used to identify noisy pixels, dividing pixels into noisy and noise-free pixels. Based on these detection results, a mask matrix is built where each entry is a binary label indicating whether or not the pixel is corrupted. In the noise removal stage, modified TV (MTV) diffusion is applied on the noisy pixels, while the noise-free pixels are left unchanged. To achieve better results, diffusion operations are iteratively implemented following the mask matrix instructions. To reduce the number of iterations, the initialization image in the iterative process is an evolved intermediate image, rather than a noisy image, created by a selected mean filter, that is, the acceleration module.
(a) Denoising structure for SPM
(b) Denoising structure for RDM
Inset (b) in Figure 1 shows the denoising structure in RDM. In contrast to SPM, the pixels are divided into three categories, that is, noise-free, noisy, and possibly noisy pixels. Pixels falling into different categories are processed differently. If a pixel is declared as noisy, it is processed by MTV diffusion; if the pixel is declared as a possibly noisy one, it is processed by weighted TV (WTV) diffusion; otherwise, it is noise-free and is left unchanged.
3.2. Noise Detection Methods
There are two noise detection methods corresponding to SPM and RDM, respectively. Both are based on the local neighborhood. Let be referred to as the current pixel centered in the sliding window; then, the neighborhood of the current pixel is defined by where is a positive integer representing the neighborhood radius and is the image domain. From the definition, a neighborhood contains pixels.
The Noise Detection Method in SPM. In this method, pixels with intensity 0 or 255 are the noisy pixel candidates. For each candidate, denoted by , the absolute differences of intensities between it and every pixel within the neighborhood are calculated, and then the number of pixels, whose absolute difference is larger than a predefined threshold value, is determined, expressed aswhere denotes the number of the pixels that satisfy the threshold condition, the symbol # denotes the cardinality of the set, and is the predefined threshold value.
The number is used to determine whether a current candidate is corrupted as a noise-free image usually consists of local smoothly varying areas separated by edges, while salt-and-pepper noise takes a value substantially larger or smaller than its neighbors. The concrete reasons are twofold. (i) If is a noisy pixel surrounded by a flat region, is very large with high probability, whereas if is a noise-free pixel, is very small with high probability. (ii) If is a noisy pixel riding on edges, is large with high probability, whereas if is a noise-free pixel, is small with high probability. Therefore, can be used to determine whether is a noisy pixel or not by a given threshold, denoted by . The determining function is In this equation, if , then candidate is corrupted; otherwise, it is uncorrupted. When all candidates are complete, a binary mask matrix can be built; each entry is either 1 or 0.
The Noise Detection Method for RDM. In this method, all the pixels are the noisy pixel candidates. We employ the Rank-Ordered Absolute Differences (ROAD) method [11] to assign a fuzzy index to each pixel. Based on these indices, the corresponding pixel is judged as corrupted or uncorrupted. Let be the current pixel; the ROAD of is defined by where andThen, the index of iswhere and are predefined threshold parameters. , , is a determining function, which divides pixels into three categories. If , is declared as noise-free; if , is declared as noisy; otherwise, it is a possibly noisy pixel.
3.3. Modified Diffusion Methods
Pixels falling into different categories are processed in different ways. In SPM, only noisy pixels are processed. Let denote the noisy pixel domain; modified TV diffusion is applied on the noisy pixels, given byApplying Euler-Lagrange method to (18), the modified TV descent flow can be written aswhere denotes the noisy image, , and is a positive lifting parameter in order to avoid vanishing.
Three categories of pixels, noise-free, noisy, and possibly noisy, are considered in RDM. For noise-free and noisy pixels, processing is the same as in SPM. Weighted TV diffusion, however, is applied on possibly noisy pixels. The weight assigned to the current pixel is obtained bywhere denotes the th iteration, denotes the weight at the th iteration, and The diffusion operation is implemented iteratively. A scaled version of the current residual error, , is also considered. Synthesizing the different processing approaches, the descent flow associated with RDM is given bywhere and denote the noisy pixel domain and the possibly noisy pixel domain, respectively.
Discretization of the divergence must be discussed, and discrete schemes for (19) and (22) are detailed. By using the central finite difference technique and half-pixel resolution, the divergence at the current pixel is expressed aswhere and are the first-order derivatives in the and directions, respectively.
Figure 2 illustrates the discretization at a half-pixel resolution. At the half-pixel , the three formulas hold as follows:Thus,whereSimilarly, at the other three half pixels,where Substituting (25) and (27) to (23), the divergence at the current position can be discretized as where , , denote the 4 neighbors of the current pixel; that is,Therefore, for flow (19) in SPM, the explicit discrete scheme isfor flow (22) in RDM, the explicit discrete scheme isIn (31) and (32), denotes the time marching step size and the superscript denotes the th iteration where denotes the desirable number of iterations.
3.4. Acceleration in SPM
In (19), the initialization image is a noisy image; that is, . To decrease the number of iterations, a noisy image is replaced by an evolved intermediate image. In this paper, a selected mean switching filter was used to obtain the evolved intermediate image.
The selected mean switching filter consists of noise detection and noise removal. The noise detection employs the SPM detection method, and noise removal takes the arithmetical mean of uncorrupted pixels within a neighborhood as the current output. The details of the latter process are discussed as follows.
Let be the noise-free set where the superscript is the complementary operator; the noise-free neighborhood is defined as where is the neighborhood of the current pixel and is the filtering window radius.
Using the arithmetical mean operator, denoted by the symbol mean, the selected mean filtering isWhen complete, an evolved intermediate image is obtained, denoted by . Therefore, the accelerated diffusion method can be written asNext, the acceleration performance is validated. For ease of formulation, (19) is termed nonaccelerated and (35) is called accelerated. The two methods are applied to the same test image Barbara, sized , with different density noise. For fixed density noise, when PSNR (similar to SSIM) reaches the peak value in the iterative process, the corresponding iterative times are noted. The numbers of iterations associated with different density noise are shown in Table 1. For example, when noise density , at least 180 iterations were needed to achieve a peak value of PSNR for the nonaccelerated image, while for the accelerated image, 43 were required. Almost the same results were obtained for the SSIM metric. Figure 3 illustrates the acceleration process comparing iterative progress when noise density . From Table 1 and Figure 3, we can draw a conclusion that the number of iterations for an accelerated image was about a fourth of that for the nonaccelerated one, under the same conditions, .
(a)
(b)
3.5. Computational Complexity in RDM
The computational complexity of the proposed method in RDM is discussed in this subsection. The time expended during the judgment operation was not considered, so these values were excluded from calculations. Let there be pixels in an image. As calculating each ROAD (15) requires operations, using quick sort, the number of operations required to build the mask matrix can be bounded by . In each iteration of the removal stage, obtaining an estimate of the noise-free pixel requires operations if a pixel is declared as corrupted and requires operations if the pixel is declared as possibly corrupted, as in (32). Let there be corrupted pixels and possibly corrupted pixels; obtaining an estimate of the noise-free image requires operations per iteration. Therefore, when iterations are completed, the number of operations for the total complexity isTo better illustrate the computational complexity in RDM, the image Monarch (shown in Figure 4) was taken to test, sized , with 0.05 density salt-and-pepper noise. Using Matlab implementation, on eight machines with Intel(R) Core(TM) i7-4702MQ CPU at 2.20 GHz, took 62.4213 seconds when and .
4. Experiments
In our experiments, two metrics were used to evaluate noise removal performance, the Peak Signal-to-Noise Ratio (PSNR) and the Structural Similarity Index Measure (SSIM), introduced briefly in this section.
4.1. Two Metrics
The PSNR measurement is based on pixel intensity errors between the noise-free and the restored images. The calculation form of PSNR is given bywhere is the cardinality of image, denotes the Frobenius norm, and and are the noise-free and the restored images, respectively.
The SSIM measurement is based on structural similarity. Its computation involves two blocks, denoted by and . Let and be the mean values of and , respectively, and be the variances, and be the covariance; thus, the calculation of SSIM is as follows:where and denote two stabilization variables. Actually, the measurement is the mean SSIM that yields mean value of the structural similarity between the blocks of noise-free image and restored image . In this paper, the SSIM is referred to as the mean SSIM.
4.2. Setting Parameters
The Parameters in SPM. A total of six parameters are set in the proposed SPM method. As seen in inset (a) in Figure 1, three parameters are used in the noise detection module; two parameters are used in the noise removal module; and the parameter is used in the acceleration module. For all noise levels, were set to 2, 60, and 3, respectively. The time step size was set to 0.8, which conforms with the CFL criteria. The desirable number of iterations depends on the noise density and the time step size . The higher the noise density or the larger the time step size is, the more the iteration is needed. The values of in our experiments are shown in Table 1 when is set to 0.8. The parameter depends on noise densities. The value of this parameter should be greater than or equal to the number of noisy pixels within the sliding window [31]. The setting values of in our experiment can be seen in Table 2.
The Parameters in RDM. There are six parameters to be set in the proposed RDM method. As seen in inset (b) in Figure 1, four parameters are used in the noise detection module, and two parameters are used in the noise removal module. In our experiments, the density noise is not larger than 60%, and the four parameters were set to 2, 14, 150, and 320, respectively, and the time step size was set to 0.5. Similar to the SPM method, the desirable number of iterations depends on the noise density and the time step size . In RDM, the values of for RDM can be seen in Table 3 when .
All the parameters used in our experiments are summarized in Table 4.
4.3. Results and Comparisons
Experimental Results and Comparisons in SPM. A test set was built to evaluate the proposed method in SPM, which was a combination of three groups, denoted by . Each group contained corrupted versions of seven images, with different density salt-and-pepper noise. The original noise-free images associated with , , and are shown in Figures 4, 6, and 8, respectively. They include miscellaneous, texture, and biomedical images taken from the CVG-Granada database.
The proposed SPM method was applied on the test set . The parameters were set in accordance with the SPM field shown in Table 4. The PSNR and SSIM results associated with , , and are reported in Tables 5, 6, and 7, respectively. Moreover, the visual results and zoom-in for the three images (i.e., Lena, Brickwall, and Breast) are shown in Figures 5, 7, and 9, respectively.
To augment the performance evaluations, the proposed SPM method was compared with MED [1], WMF [3], SMF [6], RAMF [31], and SGM [7]. The MED filter used the sliding window of size . The WMF duplicated the current pixel twice and each of the 4 neighbors duplicated itself once, while the pixels on the diagonal were not duplicated, in a window of size . The SMF used the median-based impulse detector, with a window of size and selecting determining threshold value 70. In the Rank-Ordered Adaptive Median Filter (RAMF), when noise densities were 0.05, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, and 0.9, the maximum window radius values were set to 1, 2, 3, 4, 4, 5, 5, 6, and 6, respectively. The source codes of SGM were taken from the original authors [7], and the parameters used in the experiments are those recommended by the authors. The five methods were applied on the same test set . Along with the proposed method in SPM and the noisy method, the PSNR/SSIM results from the seven methods are presented in Table 8, and the highest PSNR/SSIM result for each method and on each noise level is highlighted in bold. The noisy method means that the metrics in (37) and (38) employ noisy images , rather than restored images . Apart from the comparative PSNR/SSIM results, visual comparison results for the Barbara and Heart images are shown in Figures 10 and 11, respectively, and the information about these images is labeled sideways.
From the quantitative measurement and visual results in SPM, we make the following observations and conclusions. Firstly, the proposed method achieved the highest PSNR and also the highest SSIM in almost every case. The proposed method achieved a 0.12 dB improvement over the SGM method on average and significantly outperformed the RAMF, the SMF, the WMF, and the MED filter by 6.35 dB, 14.11 dB, 17.89 dB, and 16.49 dB on average, respectively, in the PSNR results. The proposed method achieved a 0.008 improvement over the SGM method on average and significantly outperformed the RAMF, the SMF, the WMF, and the MED filter by 0.097, 0.379, 0.443, and 0.428 on average, respectively, in the SSIM results. Secondly, the proposed method has strong capability to preserve details. It reconstructed more image details from the noisy image than the RAMF, the SMF, the WMF, and the MED filter and was also superior to the SGM method. In particular, the tumor in the breast is clearly visible in the restored image produced by the proposed method, even though the Breast image was corrupted by very high noise, as can be seen in Figure 9. Thirdly, the proposed method was more robust to different noise strengths than the five comparative methods.
Experimental Results and Comparisons in RDM. By employing the twenty-one original noise-free images, another test set was built for the proposed method in RDM, denoted by . In each group , the noisy versions of seven images were with different densities of random valued impulse noise. Using the parameter values shown in the RDM field in Table 4, the proposed RDM method was applied to the test set ; the corresponding PSNR and SSIM results are reported in Table 9. The visual results associated with the Lena image are shown in Figure 12.
For comparisons, another two close methods were applied on the test set . One is the TVD method (see (6)), where the noise-free and noisy pixels are processed uniformly. The other is the NSDD (see (10)) [23]. TVD uses a 0.5 time step size. The NSDD parameters were those recommended by the authors. Apart from the close methods, three additional filters, MED [1], WMF [3], and SGM [7], were appended for comparisons. They were also applied on the same test set . The MED filter used the sliding window of size . The WMF duplicated the current pixel twice and each of the 4 neighbors duplicated itself once, while the pixels on the diagonal were not duplicated, in a window of size . The source codes of SGM were taken from the original authors [7], and the parameters used in the experiments are those recommended by the authors. The PSNR and SSIM results of the five methods are also reported in Table 9, and visual results associated with the Lena image are also shown in Figure 12.
In addition, the mean PSNR and mean SSIM results for fixed noise are calculated for noisy images, the MED filter, WMF, SGM, TVD, NSDD, and the proposed method in RDM, respectively. The corresponding calculation is as follows:In the above two formulae, denotes all the noisy images with the same density noise in , and and denote the PSNR and SSIM values of the th image with the noise of density , respectively. For example, if (39) is applied to the proposed RDM method, denotes the mean PSNR of the twenty-one images on the 0.05 density noise. The mean values of the two metrics on different noise levels are plotted in Figure 13.
(a)
(b)
We draw the following observations and conclusions from the quantitative measurements and visual results in RDM. Firstly, the proposed method achieved the best results in every case tested. The proposed method achieved 1.441 dB improvement over the SGM method on average and significantly outperformed the NSDD, MED, WMF, TVD, and the noisy method by 3.486 dB, 5.478 dB, 6.106 dB, 9.283 dB, and 16.123 dB on average, respectively, in the PSNR results. The proposed method achieved 0.029 improvement over the SGM method on average and significantly outperformed the NSDD, MED, WMF, TVD, and the noisy method by 0.118, 0.207, 0.218, 0.274, and 0.663 on average, respectively, in the SSIM results. Secondly, the proposed method has a strong capability to preserve detail. The proposed method reconstructed more image details from noisy images than SGM, NSDD, TVD, WMF, and MED. A few strong noisy pixels appeared in the filtered image by the SGM method. The NSDD method created ring artifacts on smooth regions; the TVD method introduced too much smoothing and resulted in blurred visual features; the MED filter and the WMF worked quite well on low noise but faltered on high noise. Thirdly, the proposed method was more robust to noise density than the five comparative methods.
In summary, the proposed method shows strong capability of reducing noise not only in SPM but also in RDM, in terms of the PSNR/SSIM results. In addition, it produced a higher visual perception quality in restored images, in comparison with results from other methods.
4.4. Comparison of Computational Complexity in RDM
The computational complexity of the proposed method was compared with the NSDD method in RDM. Both denoising structures consist of two stages: detection and removal. As an analogy, calculating in (10) is equivalent to obtaining the determining function in (17), and the flow of NSDD in (10) is equivalent to the flow in (22). However, there exist some differences. The function is calculated only once, while need to be updated once per iteration; the flow in (22) is for a part of an image domain, while the flow in (10) is for all pixels in the image domain; the number of iterations in the proposed method is larger than in the NSDD method. From this analysis, the computation time of the proposed method is shown to be shorter than that of NSDD during iteration, but the total computation time was longer because the proposed method needs more iterations than NSDD. The Monarch image was tested, with 0.05 density noise. The proposed method took 0.5837 seconds for an iteration, while the NSDD took 1.8258 seconds; the proposed method took 62.4213 seconds to yield a restored Monarch image, while the NSDD took 13.4974 seconds, using Matlab-R2012b implementation on eight machines with Intel(R) Core(TM) i7-4702MQ CPU at 2.20 GHz.
5. Conclusions
In this paper, a new method is proposed to reduce impulsive noise for grayscale images. The proposed method consists of two schemes associated with the salt-and-pepper noise and random valued impulse models, respectively. In the salt-and-pepper noise model, the detector uses two thresholds () to divide pixels into corrupted and noise-free. If a pixel is declared as corrupted, modified total variation diffusion is applied; otherwise, the pixel is left unchanged. In addition, an acceleration method is proposed to reduce the computation cost for the salt-and-pepper noise model. The initial image for the iterative process is an evolved intermediate image, rather than a noisy image. In the random valued impulse model, a ROAD detector uses three thresholds () to divide pixels into corrupted, noise-free, and possibly corrupted. If a pixel is declared as corrupted, modified total variation diffusion is applied; if it is declared as a noise-free pixel, weighted total variation diffusion is applied; otherwise, the pixel is left unchanged. In experiments, two test sets associated with the two noise models were built for evaluations of the proposed method. Experimental results show that the proposed method is robust for different strength noise; for example, it can restore the images corrupted by salt-and-pepper noise whose densities vary from 5% to 90% and can restore the images corrupted by random valued impulse whose densities vary from 5% to 60%. Moreover, the proposed method exhibits strong capabilities for noise removal in terms of PSNR/SSIM results and the visual perception quality of restored images.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Acknowledgments
This work is partially supported by the Foundation Science and Forefront Technology of Chongqing Science & Technology Commission under Grant no. cstc2016jcyjA0571 and also supported by Ph.D. Cultivation Foundation of Chongqing University of Posts and Telecommunications under Grant no. RC 2016002.