- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Mathematical Problems in Engineering
Volume 2013 (2013), Article ID 480274, 12 pages
An Efficient Universal Noise Removal Algorithm Combining Spatial Gradient and Impulse Statistic
College of Automation, Chongqing University, Chongqing 400030, China
Received 20 March 2013; Revised 22 May 2013; Accepted 11 June 2013
Academic Editor: Marco Perez-Cisneros
Copyright © 2013 Shuhan Chen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
We propose a novel universal noise removal algorithm by combining spatial gradient and a new impulse statistic into the trilateral filter. By introducing a reference image, an impulse statistic is proposed, which is called directional absolute relative differences (DARD) statistic. Operation was carried out in two stages: getting reference image and image denoising. For denoising, we introduce the spatial gradient into the Gaussian filtering framework for Gaussian noise removal and integrate our DARD statistic for impulse noise removal, and finally we combine them together to create a new trilateral filter for mixed noise removal. Simulation results show that our noise detector has a high classification rate, especially for salt-and-pepper noise. And the proposed approach achieves great results both in terms of quantitative measures of signal restoration and qualitative judgments of image quality. In addition, the computational complexity of the proposed method is less than that of many other mixed noise filters.
Noise can be easily introduced into digital images due to analog-to-digital conversion errors and malfunctioning pixel elements in the camera sensors [1, 2]. Noise can significantly degrade the image quality and increase the difficulty in subsequent processing, such as image segmentation, object recognition, and edge detection. Therefore, noise removal becomes a necessary and fundamental step in image processing. However, noise removal is a difficult task because images may be corrupted by different types of noise. Fortunately, most noise added to images can be modeled by Gaussian noise and impulse noise .
Gaussian noise is always introduced during acquiring images and can be characterized by adding a zero-mean Gaussian distribution value into each image pixel [2, 3]. Based on this distribution property, it can be removed by locally averaging operation in general . Classical linear filters are the common choice, such as the Gaussian filter which is a widely used method to remove Gaussian noise, however, it blurs edges and details significantly. In order to preserve edges and details in images while removing noise; Tomasi and Manducci proposed a bilateral filter that uses weights based on spatial and radiometric similarity [4–6]. The bilateral filter has proven to be very useful; however, it is slow. To solve this problem, Paris and Durand proposed a fast approximation of the bilateral filter based on a signal processing interpretation . It downsamples convolution computation significantly without impacting the result accuracy.
Impulse noise can occurr in image transmission and characterized by replacing some pixels with noise while retaining the rest . The Gaussian noise removal methods mentioned above cannot adequately remove impulse noise. Therefore, nonlinear filters have been developed for removing impulse noise such as the traditional median filter [8, 9]. The median filter has been widely applied in impulse noise reduction because of its simplicity and high computational efficiency . Since an entire image is replaced by median values, median filter also modifies uncorrupted pixels. To improve performance, extensions of the median filter [10–16] and switching scheme methods are proposed. The switching scheme detects impulse noise pixels first and then replaces them with estimated values while keeping the remaining pixels unchanged [6, 10, 13, 17]. The main drawback of these filters is that they just use median values or their variations to estimate the noisy pixels, which can cause some image details to be distorted. To overcome this, fuzzy techniques are introduced for noise removal [18–20]. With suitable fuzzy system model, they can preserve image details during noise removal. The performances of these filters also depended on the accuracy of noise detectors. Garnett et al. proposed a rank-ordered absolute differences (ROAD) statistic to identify the impulse noisy pixels and incorporated it into a trilateral filter to remove impulse noise . It has proven to be a good impulse noise detector even with high noise level. Based on ROAD, Dong et al. proposed a rank-ordered logarithmic differences (ROLD) statistic to improve the accuracy of noise detection . Although it obtained better performance, its running time is significantly increased comparing with the previous mentioned filters due to the logarithmic computation. In , Yu et al. presented a rank-ordered relative differences (RORD) statistic through introducing a reference image and combining with a simple weighted mean filter. It can not only remove impulse noise but also preserve image details.
Mixed noise could appear during transmitting an already noise corrupted image over faulty communication lines . In such situation, most of the filters mentioned above will be useless. The median-based signal-dependent rank-ordered mean (SD-ROM) filter proposed by Abreu et al. can be used for mixed impulse and Gaussian noise removal . But it often produces visually disappointing output when applied to images with Gaussian or mixed noise . The trilateral filter with the ROAD noise detector  can remove both Gaussian and impulse noise effectively; however, it takes a long processing time due to the calculation of radiometric weighting function. In , Lin et al. proposed a switching bilateral filter with a texture/noise detector capable of removing mixed noise effectively, but for impulse noise it is not as good as SD-ROM, and for Gaussian noise it is not as good as bilateral filter. More recently, there are also some novel and encouraging approaches proposed [24, 25].
In this paper, we first propose a directional absolute relative differences (DARD) statistic for impulse noise detection by using a reference image which is similar to RORD. Different from RORD detector, our impulse detector does not need sort operation, which can reduce computation complexity. Then, we propose an improved trilateral filter by combining spatial gradient and the DARD statistic. Instead of applying the “detect and replace” methodology of most impulse noise removal techniques, we integrate our two statistics into a filter designed to remove impulse noise, Gaussian noise, and mixed noise. Finally, a two-step iterative algorithm mentioned in  is adopted, which includes getting reference image and image denoising.
The remainder of the paper is arranged as follows. In Section 2, we first briefly review ROAD, ROLD, and RORD statistics and then introduce our DARD statistic. Section 3 describes how to incorporate our statistics into the bilateral filter to create two new bilateral filters for Gaussian and impulse noise, respectively, and a new trilateral filter for mixed noise. In Section 4, we provide the simulations on noise detection and noise removal with visual examples and numerical results. Finally, conclusions are drawn in Section 5.
2. DARD Statistic for Detecting Impulse Noise
2.1. Review on ROAD, ROLD, and RORD
First, let denote the absolute difference between and its neighbor in a window as Then we define where is the th smallest one among .
For noisy pixels, their intensities vary greatly from their neighbors and yield large ROAD values, while noise-free pixels should have similar intensities with their neighbors and produce small ROAD values. Thus, we can identify noise by the ROAD value. However, the ROAD value of a pixel may not be large enough for it to be distinguished from noise-free pixel when the noise value is close to its neighbors . Then, ROLD was proposed to solve it by introducing a logarithmic function on the absolute difference defined as Then, define ROLD as where is the th smallest one among .
Although ROLD is more accurate than ROAD to separate noisy pixels from noise-free pixels, it significantly increases computation complexity.
Yu et al. found that ROAD is not accurate at edge pixels because edge details in an image also cause large absolute difference values . Thus, they solved it by introducing a reference image, which is defined as Then, and RORD were defined as follows: where is the th smallest one among .
Merging (5) into (6), can be rewritten as With the help of subtracting , RORD can distinguish noisy pixels from edge pixels well. However, may be noisy especially when the noise level is high. In such case, RORD may be not accurate. Although it may be more robust by accumulating smallest ones among , it brings errors at the same time. Take Figure 1 for example, in the window of the center pixel, half or more than half of its neighbors are corrupted with impulse noise, and then RORD will falsely mark the center pixel as a noise. However, the proposed DARD can work well in this case, which will be described in the next subsection.
2.2. Definition of DARD
Our new impulse detector is based on the following two assumptions. (1) Noise-free images contain locally smoothly varying areas separated by image edges . (2) Noisy pixels take gray scale values substantially smaller or larger than their neighborhoods [26, 27]. Here, we only focus on the edges aligned with four main directions shown in Figure 2. Let denote a set of coordinates aligned with the th direction centered at with window size , that is,At first, we introduce a reference image () that contains the original image edge information from the noisy image. In the filter window centered at , for each direction, define as the sum of all absolute differences of gray-level values between centered pixel in and its neighbors in . Then, we have Similarly, we define as the sum of all differences of each direction in the reference image as Finely textured or detailed regions in an image cause some kind of naturally large absolute difference values. Therefore, it is difficult to tell the difference between a texture and an impulse noise. In order to solve this case and improve the accuracy of impulse noise detection, we define an absolute relative difference statistic for each direction as follows: If is set to 1, and the reference image is equal to the original image, then, all intensity variation caused by edges can be eliminated. However, the reference image is just generated from the noisy image by median filter (detailed generation process is shown in Section 3.2), in which only rough information of the original image is contained. In other words, the reference image can still be noisy, not only the edge details, which can also cause large intensity variation. To reduce it, we set for simplicity. Finally, the directional absolute relative difference statistic is defined as Then, the decision making mechanism can be realized by employing a threshold and the impulse noise detection algorithm is shown as In general, salt-and-pepper noisy pixels have larger DARD values while random-valued impulse and Gaussian ones have smaller DARD values, which can be seen in Figure 3.
3. The Proposed Method
3.1. New Weighting Functions
Bilateral filter presented by Tomasi and Manduchi  has been proven to be very useful in removing Gaussian noise and simultaneously preserving edge details. Its main idea is combining grey levels based on both the photometric similarity and geometric closeness. It shows great results but takes a long processing time. Although some improved methods have been proposed, they are not efficient enough [7, 28]. Furthermore, the performance of the bilateral filter is degraded with high noise level as mentioned above. In this work, we present two new weighting functions for designing filters, as discussed below.
Spatial gradient statistic is first introduced into the bilateral filtering framework through replacing the radiometric weighting function. The new created bilateral filter, named SG-BF, is capable of removing Gaussian noise while keeping edge details. The new weighting function is defined as Here, is gradient which can be generated by using Sobel operator. Let be the current pixel, and let be the pixels in a window that surrounds ; and are the locations of and . Then the new output of SG-BF is defined as where By replacing radiometric weighting function with , our running time can be significantly reduced comparing with the original bilateral filter. In order to let bilateral filter be capable of removing impulse noise, we further incorporate the DARD statistic into the bilateral filter to create a new bilateral filter, and we name it DARD-BF. The new weighting function is defined as Then, the new output of DARD-BF bilateral filter is defined as Finally, we combine the spatial gradient with the DARD statistic to create a new trilateral filter, which can remove both Gaussian and impulse noise, and we name it SG-DARD-TRIF. The new output of SG-DARD-TRIF is defined as In brief, our new trilateral filter can not only preserve the bilateral filter’s ability to remove Gaussian noise but also work well for impulse noise. For images with no impulse noise, the value of impulsive component is nearly to one except for few points with high DARD values, and thus the impulsive component will be “shut off” and only the spatial and gradient weights are used. Essentially, the trilateral filter reverts to the bilateral filter when processing images with Gaussian noise only. For images with impulse noise only, the gradient component will also help to enhance the performance of impulse noise removal.
3.2. Denoising Algorithm
As can be seen, the reference image plays an important role in our algorithm. In order to get a satisfactory denoising result, we adopt the two-step iterative algorithm mentioned in . In the first step, the initial reference image is generated by using the standard median filter (SMF). If the noise ratio is high, two or more iterations are needed. In the second step, the previously generated restoration result is used as the final reference image. Then the more accurate impulse noise detection result is obtained by using the more satisfactory reference image. Finally, the final restored image will be obtained by using our new bilateral filter (DARD-BF) or trilateral filter (SG-DARD-TRIF). Different from , iterative operation is only applied in the first step. Our new denoising algorithm, DARD-BF and SG-DARD-TRIF, is summarized as follows.(1)Getting Reference Image.(a)Set , , and .(b)Restore all pixels by DARD-BF or SG-DARD-TRIF and get the new reference image , .(c)If , set and then go to step 1(b); Otherwise, stop iteration and get the final reference image.(2)Image Denoising. If , restore all these pixels by DARD-BF or SG-DARD-TRIF; otherwise, take .
In general, we use window median filtering in step 1, and use window for calculating DARD values in step 2. If the noise ratio is higher than 25%, two or three iterations and 5 × 5 window median filtering are needed in step 1. By tries and errors, threshold is set as , with a higher value for salt-and-pepper noise but a lower one for random-valued impulse noise and Gaussian noise. It is worth noting that we do not employ threshold in step 1, which is different from many other methods [6, 17, 21, 22]. Although some suggestions of threshold selection are given in their literatures, it still needs trial and error. Therefore, we do not apply “detect and replace” scheme. In this work, threshold is not as important as the other methods, which means that the proposed method can still work well when threshold is set as 0.
The performance of the proposed filters have been evaluated and compared with those of several existing filters for image restoration. The proposed method produced results superior to other methods in both visual image quality and quantitative measures. Simulations were made on several gray scale standard test images corrupted with Gaussian noise, salt-and-pepper noise, random-valued impulse noise, and mixed noise. For illustrations, the results for images “Lena”, “Boats”, “Bridge”, “Baboon”, and “Barbara” are presented here.
4.1. Selection of Parameters
There are three parameters in our algorithm: (controls spatial weight), (controls gradient weight), and (controls DARD weight). From simulations on a large variety of images, we found that the better performance was obtained by the following settings: should be in the interval [0.3, 0.8] for all kinds of noise. In general, the selection of yields satisfactory results for salt-and-pepper noise, while the setting of consistently performs well for random-valued impulse noise. For Gaussian noise, should be in the range of [0.8, 2.0], while [0.4, 1.0] for others. In addition, higher values of and work better with high noise level and higher performs well in images with more textured details.
4.2. Noise Detection
To demonstrate the effectiveness of our DARD statistic, we make a test on a Lena image compared to ROAD, ROLD, and RORD. Here, we suppose the locations of all noisy pixels are known in advance, and then all pixels can be grouped into two sets: the noisy pixel set and the noise-free pixel set.
A good noise detector should be able to identify most of the noisy pixels and noise-free pixels, and yet its classification rate should be as high as possible. The classification rate (CR) is defined as The results are shown in Table 1. From the experiment results, it can be seen that our DARD detector achieves significant improvement over other detectors for salt-and-pepper noise, especially when the noise level is higher than 40%. For random-valued and mixed impulse noise, our DARD detector also shows better results than ROAD and ROLD detectors. Although the classification rate is slightly lower than RORD, our DARD detector has fewer edge pixels falsely detected as noise pixels. The reason is due to the fact that more pixels in subwindow are considered in RORD. Figure 4 shows the results in detecting Lena image, which is corrupted with 20% random-valued impulse noise, where the white denotes detected noise pixels and the black denotes noise-free pixels. It is clear that the DARD detector has the fewest edge pixels falsely detected as noise pixels.
4.3. Image Quality
To ensure that our approach provides a visually pleasing output, we make three simulations as follows. One is the Lena image contaminated by mixed salt-and-pepper and Gaussian noise with and . The other one is the Boats image corrupted by mixed random-valued impulse noise and Gaussian noise with % and . The last is the Bridge image corrupted by mixed salt-and-pepper and random-valued impulse noise with %. The results are shown in Figures 5, 6, and 7. It is clear to see that the SG-DARD-TRIF can remove noise while preserving the edge details by comparing with the original image.
4.4. Signal Restoration
The objective quantitative measures used for comparison are the mean absolute error (MAE)  and the peak signal-to-noise ratio (PSNR)  between the original and restored images, defined by where and denote the pixel values of the original image and the restored image, respectively, and the image size is . Larger PSNR value signifies better image restoration while lower for MAE.
Our first goal is to ensure that the proposed filters can effectively restore the pixels corrupted by impulse noise. This can be justified by comparing the performance of our approach with other well-known filters for impulse noise reduction. The group of these filters consists of the standard median filter, the adaptive center-weighted median filter (ACWMF) , the SDROM filter, the switching bilateral filter (SBF), ROAD-TRIF, ROLD-EPR, ROLD-WMF, and DWM filter. The results of PSNR and MAE values on salt-and-pepper noise are shown in Table 2. The proposed method shows significant better PSNR and MAE values than other filters both for Lena and Boats images. Table 3 shows the PSNR and MAE values for random-valued impulse noise, and the proposed filters also show better results than other filters except the RORD-WMF. It is noted that the PSNR and MAE values of our SG-DARD-TRIF are slightly better than our DARD-BF, which denotes that the use of the spatial gradient can enhance the filter’s performance.
We also compared the performance of the proposed SG-BF with the performance of the previously tested filters on images corrupted with Gaussian noise. From Table 4, we can see that SG-BF produces nearly the same results with the bilateral and trilateral filters when , but it shows better results than these two filters when . Thus, our SG-BF is better than these existing filters when image is highly corrupted with Gaussian noise. Tables 5 and 6 show PSNR and MAE values corrupted with three kinds of mixed noise: salt-and-pepper and Gaussian with % and ; random-valued impulse and Gaussian with % and ; salt-and-pepper and random-valued impulse with %. The proposed SG-DARD-TRIF consistently yields the best PSNR and MAE values for each image corrupted with the first two mixed noises. Note that it outperforms the other methods a large margin in images with salt-and-pepper and Gaussian noise due to its high salt-and-pepper noise detection rate. For mixed impulse noise, the RORD-WMF shows better results in each image and the SG-DARD-TRIF is very close to it.
Many noise removal algorithms, such as the ROAD-TRIF and ROLD-EPR, tend to neglect the image edge information and, hence, end with unsatisfactory results. RORD-WMF introduces a reference image which is obtained by standard median filter to solve this problem; however, the edge direction information is still not considered. Although the DWM filter introduces the edge direction information into the median filter, the performance hardly dependeds on the accuracy of edge direction calculation. Furthermore, most of the existing filters do not have the ability of removing both impulse noise and Gaussian noise or cannot perform well. Therefore, a new trilateral filter based on DARD statistic and spatial gradient is proposed to handle these problems. The DARD statistic represents how impulse-like a particular pixel is in the sense that the larger the impulse, the greater the DARD value, while the spatial gradient is for Gaussian component weight. We incorporate the DARD statistic and spatial gradient into the Gaussian filtering framework by adding two components to the weighting functions. The weighting functions of the new trilateral filter contain spatial, gradient, and impulsive component. The gradient component combined with the spatial component smoothes away the Gaussian noise, while the impulsive component removes larger impulse noise. To demonstrate the superior performance of the proposed method, extensive experiments have been conducted on several standard test images to compare our method with many other well-known techniques. Experimental results indicate that the proposed method performs better in removing Gaussian and mixed noise as well as in removing impulse noise than many other existing techniques.
The authors thank the anonymous reviewers for the help in improving this paper. This work is partly supported by the National Science Foundation of China (90820017), National Key Technology R&D Program (2011BAK07B03), and National Science and Technology Major Project (2009ZX07528-003-09).
- R. C. Gonzalez and R. E. Woods, Digital Image Processing, Prentice-Hall, Englewood Cliffs, NJ, USA, 2002.
- R. Garnett, T. Huegerich, C. Chui, and W. He, “A universal noise removal algorithm with an impulse detector,” IEEE Transactions on Image Processing, vol. 14, no. 11, pp. 1747–1754, 2005.
- W. K. Pratt, Digital Image Processing, Wiley, New York, NY, USA, 1978.
- C. Tomasi and R. Manduchi, “Bilateral filtering for gray and color images,” in Proceedings of the 1998 IEEE 6th International Conference on Computer Vision, pp. 839–846, January 1998.
- M. Elad, “On the origin of the bilateral filter and ways to improve it,” IEEE Transactions on Image Processing, vol. 11, no. 10, pp. 1141–1151, 2002.
- C. H. Lin, J. S. Tsai, and C. T. Chiu, “Switching bilateral filter with a texture/noise detector for universal noise removal,” IEEE Transactions on Image Processing, vol. 19, no. 9, pp. 2307–2320, 2010.
- S. Paris and F. Durand, “A fast approximation of the bilateral filter using a signal processing approach,” in Proceedings of the 9th European Conference on Computer Vision, vol. 3954 of Lecture Notes in Computer Science, pp. 568–580, May 2006.
- I. Pitas and A. N. Venetsanopoulos, Nonlinear Digital Filters: Principles and Applications, Kluwer, Norwell, Mass, USA, 1990.
- W. K. Pratt, “Median filtering,” Tech. Rep., Signal and Image Processing Institute, University of Southern California, Los Angeles, Calif, USA, 1975.
- T. Sun and Y. Neuvo, “Detail-preserving median based filters in image processing,” Pattern Recognition Letters, vol. 15, no. 4, pp. 341–347, 1994.
- Z. Wang and D. Zhang, “Progressive switching median filter for the removal of impulse noise from highly corrupted images,” IEEE Transactions on Circuits and Systems II, vol. 46, no. 1, pp. 78–80, 1999.
- T. Chen and H. R. Wu, “Space variant median filters for the restoration of impulse noise corrupted images,” IEEE Transactions on Circuits and Systems II, vol. 48, no. 8, pp. 784–789, 2001.
- C. T. Lu and T. C. Chou, “Denoising of salt-and-pepper noise corrupted image using modified directional-weighted-median filter,” Pattern Recognition Letters, vol. 33, no. 10, pp. 1287–1295, 2012.
- G. Pok, J. C. Liu, and A. S. Nair, “Selective removal of impulse noise based on homogeneity level information,” IEEE Transactions on Image Processing, vol. 12, no. 1, pp. 85–92, 2003.
- A. Nasimudeen, M. S. Nair, and R. Tatavarti, “Directional switching median filter using boundary discriminative noise detection by elimination,” Signal, Image and Video Processing, vol. 6, no. 4, pp. 613–624, 2012.
- K. S. Srinivasan and D. Ebenezer, “A new fast and efficient decision-based algorithm for removal of high-density impulse noises,” IEEE Signal Processing Letters, vol. 14, no. 3, pp. 189–192, 2007.
- Y. Dong and S. Xu, “A new directional weighted median filter for removal of random-valued impulse noise,” IEEE Signal Processing Letters, vol. 14, no. 3, pp. 193–196, 2007.
- H. Xu, G. Zhu, H. Peng, and D. Wang, “Adaptive fuzzy switching filter for images corrupted by impulse noise,” Pattern Recognition Letters, vol. 25, no. 15, pp. 1657–1663, 2004.
- S. Schulte, V. De Witte, M. Nachtegael, D. Van der Weken, and E. E. Kerre, “Fuzzy random impulse noise reduction method,” Fuzzy Sets and Systems, vol. 158, no. 3, pp. 270–283, 2007.
- C. C. Kang and W. J. Wang, “Fuzzy reasoning-based directional median filter design,” Signal Processing, vol. 89, no. 3, pp. 344–351, 2009.
- Y. Dong, R. H. Chan, and S. Xu, “A detection statistic for random-valued impulse noise,” IEEE Transactions on Image Processing, vol. 16, no. 4, pp. 1112–1120, 2007.
- H. Yu, L. Zhao, and H. Wang, “An efficient procedure for removing random-valued impulse noise in images,” IEEE Signal Processing Letters, vol. 15, pp. 922–925, 2008.
- E. Abreu, M. Lightstone, S. K. Mitra, and K. Arakawa, “A new efficient approach for the removal of impulse noise from highly corrupted images,” IEEE Transactions on Image Processing, vol. 5, no. 6, pp. 1012–1025, 1996.
- Y. Xiao, T. Zeng, J. Yu, and M. K. Ng, “Restoration of images corrupted by mixed Gaussian-impulse noise via l1l0 minimization,” Pattern Recognition, vol. 44, no. 8, pp. 1708–1720, 2011.
- Y. Zhou, Z. Ye, and Y. Xiao, “A restoration algorithm for images contaminated by mixed Gaussian plus random-valued impulse noise,” Journal of Visual Communication and Image Representation, vol. 24, pp. 283–294, 2013.
- D. Zhang and Z. Wang, “Impulse noise removal using polynomial approximation,” Optical Engineering, vol. 37, no. 4, pp. 1275–1282, 1998.
- S. Zhang and M. A. Karim, “A new impulse detector for switching median filters,” IEEE Signal Processing Letters, vol. 9, no. 11, pp. 360–363, 2002.
- B. Zhang and J. P. Allebach, “Adaptive bilateral filter for sharpness enhancement and noise removal,” IEEE Transactions on Image Processing, vol. 17, no. 5, pp. 664–678, 2008.
- T. Chen and H. R. Wu, “Adaptive impulse detection using center-weighted median filters,” IEEE Signal Processing Letters, vol. 8, no. 1, pp. 1–3, 2001.