Image Denoising via <svg xmlns:xlink="http://www.w3.org/1999/xlink" xmlns="http://www.w3.org/2000/svg" style="vertical-align:-4.172pt" id="M1" height="15.5197pt" version="1.1" viewBox="-0.0657574 -11.3477 17.7877 15.5197" width="17.7877pt"><g transform="matrix(.017,0,0,-0.017,0,0)"><path id="g50-77" d="M567 167L534 181C505 122 482 94 454 70C428 46 385 42 330 42C288 42 248 44 235 55C216 70 213 91 220 130L295 528C310 609 314 611 401 618L409 650H140L131 618C222 611 224 609 209 528L133 126C118 47 108 41 25 33L18 0H497C514 33 554 126 567 167Z"/></g><g transform="matrix(.012,0,0,-0.012,11.085,3.961)"><path id="g50-49" d="M245 635C92 635 37 457 37 312C37 149 91 -12 244 -12C395 -12 449 166 449 312C449 469 395 635 245 635ZM243 598C332 598 358 454 358 312C358 173 334 26 245 26C158 26 128 174 128 313S152 598 243 598Z"/></g></svg> Gradient Minimization with Effective Fidelity Term

Zhang, Wenxue; Cao, Yongzhen; Zhang, Rongxin; Li, Lingling; Wen, Yunlei

doi:https://doi.org/10.1155/2015/712801

Mathematical Problems in Engineering

On this page

Abstract Introduction Background Experimental Results Conclusion Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 712801 | https://doi.org/10.1155/2015/712801

Image Denoising via Gradient Minimization with Effective Fidelity Term

Wenxue Zhang,¹Yongzhen Cao,¹Rongxin Zhang,¹Lingling Li,²and Yunlei Wen¹

Academic Editor: Sergio Preidikman

Received25 Aug 2015

Revised28 Nov 2015

Accepted03 Dec 2015

Published30 Dec 2015

Abstract

The gradient minimization (LGM) method has been proposed for image smoothing very recently. As an improvement of the total variation (TV) model which employs the norm of the gradient, the LGM model yields much better results for the piecewise constant image. However, just as the TV model, the LGM model also suffers, even more seriously, from the staircasing effect and the inefficiency in preserving the texture in image. In order to overcome these drawbacks, in this paper, we propose to introduce an effective fidelity term into the LGM model. The fidelity term is an exemplar of the moving least square method using steering kernel. Under this framework, these two methods benefit from each other and can produce better results. Experimental results show that the proposed scheme is promising as compared with the state-of-the-art methods.

1. Introduction

Noise is inevitable in the process of image acquisition and transmission, which brings great trouble to the subsequent image analysis; therefore, image denoising is the most fundamental research topic in the community of image processing and computer vision. However, there is always a dilemma for the denoising algorithms to simultaneously remove noise and to preserve edges. The objective of almost all methods focus on how to get a tradeoff between smoothing noise and blurring edges. The state-of-the-art denoising algorithms can be categorized as those taking advantage of nonlocal similarity of patches in the image: such methods include the nonlocal mean (NL-Mean) [1], BM3D [2], and PLOW [3]; in [4], the author presented a tutorial on these state-of-the-art denoising methods, and it has been shown that the LARK [5] takes the bilateral filter [6] and the nonlocal mean (NLM) [1] as special cases and they are closely related to the anisotropic diffusion [7]; variational and partial differential equations- (PDEs-) based methods, such as the anisotropic diffusion [7], total variation [8], and related works [9–14]; and sparse representation based method, such as the K-SVD [15] and nonlocal sparse works [16, 17]. There have been a flurry of works generalizing the variational methods in nonlocal manner, such as [18, 19].

The partial differential equations (PDEs) have been justified as effective tools for image smoothing during the last two decades, which are able to achieve a good tradeoff between noise removal and edge-preserving. The characteristic of these approaches is that it takes the form of an unconstrained regularized data fitting model, where the desired image is obtained as a regularized minimizer to a certain functional which contains both regularization and fidelity terms. One of the most popular methods in this framework is the total variation (TV) method [8, 11, 13, 14, 20, 21]. It can be described as an unconstrained problem with norm of the gradient as the regularization term. Recently, Xu et al. proposed a modified scheme of the TV model by replacing norm of the gradient with norm in the optimization framework for image smoothing, that is, the gradient minimization (LGM) [22]. Compared with the TV model using the norm, the LGM model has proved to be very effective on preserving edges due to the avoidance of local filtering and of averaging operation. However, LGM scheme tends to smooth the observed image towards a piecewise constant image, which also suffers, even more seriously than the TV model, from the staircase effect, and it can remove most of the texture when applied to the texture images.

Meanwhile, a nonparametric data fitting approach based on the localized least square method has been proposed for image processing [23, 24]. This framework is represented by moving least squares (MLS) model [23], where two kinds of robust estimators were applied to the MLS for image processing. In [5], a steering kernel regression is proposed which steers the local kernels along the directions of the local edge structure; the method is typically called local adaptive kernel regression (LARK). It is the exemplar of the moving least square method using steering kernel. In [24], Lee et al. combined the MLS and the total variation used in the image denoising. The MLS method using steering kernel can preserve the texture and edges well. However, the models show weakness against outliers, which is the main reason that the denoising performance of MLS based models is usually not good.

In order to overcome the drawback of the LGM model, in this paper, we introduce the MLS model with steering kernel into the LGM model as fidelity term. The proposed scheme can provide a better solution than the conventional LGM scheme on overcoming the staircase effect and preserving texture. The proposed model also endows the MLS model with better denoising performance since LGM is strong against outliers.

The remainder of this paper is organized as follows. In Section 2, the LGM and MLS models are introduced in brief. In Section 3, the proposed model is presented and the numerical solution is given. In Section 4, the performance of the proposed model is demonstrated by experiment and comparison. Finally, conclusions are drawn in Section 5.

2. Background

In this section, we briefly review the related works, that is, the LGM [22] and MLS with steering kernel (LARK) [5], and our description follows that of [5, 22].

2.1. LGM: Gradient Minimization

Suppose is the input image and the smoothed image and and are the partial derivatives calculated between neighboring pixels along and directions, respectively. Then the gradient can be obtained for each pixel. The gradient measure of gradient minimization is expressed as follows:where is the counting operator; it counts whose magnitude is not zero, that is, the norm of gradient. To note that the measure should be combined with a general constraint, the result should be structurally similar to the input image [22]. The specific objective function is expressed aswhere indicates that nonzero gradients exist in the result. Equation (2) can be further written as an unconstrained optimization problem as follows:where is a weight directly controlling the significance of .

2.2. MLS: Moving Least Squares

Suppose that the observed image and the estimated image are, respectively, discrete sampling of functions and at an equally spaced point set in a rectangle . The task of image restoration is to estimate the image for each point given the low quality observations . In the MLS method, is always derived from a polynomial space of degree and dimension denoted by . The relationship between degree and dimension is defined as , where dimension decides the number of basis of the polynomial space . For example, if , then , and we take this combination in our implementation. We can get the polynomial space with the corresponding basis . Therefore, the form of the regression function at any point is given bywhere are the coefficients. The MLS method performs in a local manner, and the value of the estimated image at a location is influenced only by the pixels within a small neighborhood of that position. As such, MLS provides a rich mechanism for computing pointwise estimates of the function with minimal assumptions about global signal or noisy model. Define as the th sampling point around the estimated point . Usually, has to be bigger than so that the problem can be solved. Then, for any point , the polynomial approximation function is obtained by solving the following quadratic minimization problem:where denotes the kernel function, which decides how much the data point contributes to the estimated pixel value. If is large, contributes much to the estimated pixel value. In our proposed method, we employ the steering kernel function [5] that is shown in detail in the next subsection.

2.3. The Steering Kernel

A typical choice of the kernel is an isotropic Gaussian kernel, which computes a weighted average of pixel values in the neighborhood, where the weights decrease with distance from the neighborhood center. However, the isotropic Gaussian kernel suffers from severe limitation that it usually blurs the edge structures in the image. The bilateral kernel, which is a typical data-adapted kernel, can preserve the edge structures better by introducing the pixel value into the weight. However, the bilateral kernel breaking into spatial and radiometric terms ignores correlations between positions of the pixels and their values, so the performance is weakened. The steering kernel proposed in [5] measures the local structure of data by making use of an estimate of the local geodesic distance between nearby samples, so it can preserve image edges and texture well. The steering kernel is represented aswhere is a scalar that captures the local density of data samples (nominally set to ), is the global smoothing parameter, and is symmetric covariance matrices of the gradient of sample values estimated from the given data, yielding an approximation of local geodesic distance in the exponent of the kernel. This kernel is closely related but somewhat more general than the Beltrami kernel [25] and the coherence enhancing diffusion approach [26, 27].

3. Proposed Method

Since the LGM suffers from the serious staircasing effect and removes most details, we introduce an effective fidelity term that is an exemplar of the moving least square method using steering kernel. Then, the proposed model is written aswhere and are identical to those in (3) and the second part in (7) is the same as that in (5); that is, we replace the fidelity term in (3) with the weighted sum in (5) such that the LGM in (3) can preserve texture better.

The numerical methods are borrowed from [5, 22, 28]. Specifically, two auxiliary variables and are introduced to expand the original terms and iteratively updated; therefore, (7) is reformulated aswhere is an automatically adapting parameter to control the similarity between variables and their corresponding gradients. The specific solution is to split (8) into two subproblems to find and , respectively, in an alternative minimization manner.

Subproblem 1 (Computing ). When calculating , we remove the terms in which are not involved from (8). Then, the object function is written as the following form: This subproblem is similar to that in the LGM and can be easily solved by spatially decomposing so that each element and can be estimated individually. Since , therefore, (9) can be further written as whereThe energy for each element readsand each element has the following closed-form:

Subproblem 2 (Computing ). When calculating , the terms not involving are removed from (8). Then, the functional is written as the following form:Since takes the form in (4), our goal is to get the estimate value of regression coefficients , and it is possible to express (14) as a weighted least squares optimization problem [23, 24].

Let And can be rewritten in matrix form as follows:whereTo get the regression coefficients , we differentiate with respect to and set it to zero; we haveThen, we can get the estimate of as follows:The algorithm is presented in Algorithm 1.

(1) Input: noisy image , parameter, , iteration number
(2) Initialization: , , calculate .
(3) For , do
Step 1. Estimate and in (13) with
Step 2. With and , solver for
For each pixel location , do
(i) Construct the weight matrix
(ii) Calculate the regression coefficients with (19) and update the estimation with (20)
End
Update the parameter ,
End
(4) Output: smoothed image .

4. Experimental Results

In this section, we will demonstrate the performance of the proposed method and make a comparison with several state-of-the-art methods including NL-Mean [1], LARK [5], BLF [6], TV [8], K-SVD [15], LGM [22], and LMMSE [29]. Eight images are employed for test, which are shown in Figure 1 and a noisy image is coined by adding white Gaussian noise with standard deviation of to the clean one. The peak signal-to-noise ratio (PSNR) and the mean structure similarity (MSSIM) [30] are employed as object indexes to evaluate the image quality of the filtered images. The MSSIM ranges from 0 to 1 and if the filtered image is identical to the noise-free one, it is 1. Since is a weight directly controlling the significance of , which is in fact a smoothing parameter, a large makes the result have few edges. Since the “House” and “Test” images are nearly piecewise constant, the parameter is relatively small and set to 1.0e2, other images possess texture, and the parameter is 1.0e4. The parameter is multiplied with parameter in each iteration to speed up convergence [28], and it is 1.05 in all the experiments. All the parameters of the other methods are set as what have been suggested to be the optimal one in the original paper.

The PSNR and MSSIM indices of the eight models on eight images are reported in Table 1, from which one can conclude that the proposed method performs the best in terms of PSNR and MSSIM indices. This observation clearly verifies the effectiveness of incorporating MLS based fidelity term into the framework of the LGM model. It is also clear that the proposed method performs comparably to the LARK and K-SVD method in terms of PSNR and MSSIM; however, the LARK method performs visually inferior to the proposed one; let us further visually inspect the filtered images. The results of the eight methods on House image are listed in Figure 2, but only a part of the House image is shown for the sake of clarity. Visually, the TV model suffers from blocky artifacts (see Figure 2(b)); the LMMSE method blurred image edges, in Figure 2(c). The results by the BLF and NL-Mean models are somewhat foggy and misty, the BLF model performs more seriously (see Figure 2(d)), and the foggy results are visually unpleasant. The result by the LARK method is shown in Figure 2(f), where there are serious flow-like structures around the edges. The results by the K-SVD method and LGM method are presented in Figures 2(g) and 2(h), respectively. There is impulse noise in the result by the LGM method. The result by the proposed method in Figure 2(i) is more satisfactory than the that of the LARK method, although the corresponding PSNR and MSSIM indices are comparable.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

Since the proposed method employs the MLS based model as fidelity term in the LGM model, as seen in Table 1 and Figure 2, this strategy not only improves the PSNR and MSSIM indices, but also makes the filtered results closer to the original image. There are two segments in Figure 2(a), and the intensity profiles of the two segments of the noise-free image and the results by the LARK, LGM, and the proposed methods are shown in Figure 3. The intensity profiles of the results of the LARK method possess similar trend to the noise-free one; however, the intensity values are much smaller than that of the original image, which implies the LARK method reduces image contrast. The LGM method tends to make the image intensity constant and, therefore, cannot preserve the original profile. In contrast to the LARK and LGM methods, the proposed one yields result very close to, and much smoother than, the original one. This observation means the proposed method yields smooth result of high fidelity. Since the proposed method yields result of high fidelity, it can preserve texture very well. The filtered Eagle images and the corresponding residuals are shown in Figure 4. From the residuals of the LARK, LGM, and the proposed methods, the proposed method performs the best on preserving texture.

(a)

(b)

(a)

(b)

(c)

In order to demonstrate the performance of the proposed method at different noise level, the Pepper image is contaminated by additive white Gaussian noise with the standard deviation of 20, 30, and 40, and the eight models are applied to the noisy Pepper images. The PSNR and MSSIM indices are reported in Table 2 (see Table 1 when noise deviation is 20). The filtered images when noise deviation is 40 are shown in Figure 5. From Table 2, it is clear that the proposed method, LARK, and K-SVD perform comparably, but the proposed method is the best. On the other hand, the results of the proposed method are visually the best since the LARK method suffers from flow-like artifacts and the K-SVD method suffers from artifacts due to the inaccurate sparse representation.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

5. Conclusion

In this paper, we have proposed an improvement of the gradient minimization (LGM) model. The proposed model is coined by introducing the MLS based fidelity into LGM model and the fidelity term is an exemplar of the moving least square method using steering kernel (LARK). The main result is that the proposed method combines the advantages of the LGM and LARK, so that the proposed model can simultaneously preserve texture and resist the flow-like artifacts. Experiments have been conducted on both synthetic and real images, and comparisons have been launched with the classical and state-of-the-art models such as the TV, LMMSE, NL-Mean, BLF, LARK, K-SVD, and LGM models. We have evaluated these models from PSNR and MSSIM indices and visual inspection. Overall, the proposed model yields promising results and we believe that the MLS based method can also be combined with other variational methods for image filtering.

To note, the overall computational load of the proposed method is heavier than that of the model in [22] since the steering kernel has to be calculated.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

Wenxue Zhang is supported by the Chinese Society of Neuro-Oncology, Neuro-Oncology Research Project CSNO-2013-MSD003, and Lingling Li is supported by the NSFC under Grant 51475136, the Program from the Tianjin Commission of Technology of China under Grant 12JCYBJC12400, and the Natural Science Foundation of Hebei Province of China under Grant E2014202230.

References

A. Buades, B. Coll, and J.-M. Morel, “A non-local algorithm for image denoising,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR ’05), pp. 60–65, June 2005.
View at: Publisher Site | Google Scholar
K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, “Image denoising by sparse 3D transform-domain collaborative filtering,” IEEE Transactions on Image Processing, vol. 16, no. 8, pp. 2080–2095, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
P. Chatterjee and P. Milanfar, “Patch-based near-optimal image denoising,” IEEE Transactions on Image Processing, vol. 21, no. 4, pp. 1635–1649, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
P. Milanfar, “A tour of modern image filtering: new insights and methods, both practical and theoretical,” IEEE Signal Processing Magazine, vol. 30, no. 1, pp. 106–123, 2013.
View at: Publisher Site | Google Scholar
H. Takeda, S. Farsiu, and P. Milanfar, “Kernel regression for image processing and reconstruction,” IEEE Transactions on Image Processing, vol. 16, no. 2, pp. 349–366, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
C. Tomasi and R. Manduchi, “Bilateral filtering for gray and color images,” in Proceedings of the 6th International Conference on Computer Vision (ICCV ’98), pp. 839–846, Bombay, India, January 1998.
View at: Publisher Site | Google Scholar
P. Perona and J. Malik, “Scale-space and edge detection using anisotropic diffusion,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629–639, 1990.
View at: Publisher Site | Google Scholar
L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D: Nonlinear Phenomena, vol. 60, no. 1–4, pp. 259–268, 1992.
View at: Publisher Site | Google Scholar
Y. Q. Wang, J. Guo, W. Chen, and W. Zhang, “Image denoising using modified Perona-Malik model based on directional Laplacian,” Signal Processing, vol. 93, no. 9, pp. 2548–2558, 2013.
View at: Publisher Site | Google Scholar
W. X. Zhang, Y. Z. Cao, R. X. Zhang, and Y. Wang, “Image denoising using total variation model guided by steerable filter,” Mathematical Problems in Engineering, vol. 2014, Article ID 423761, 11 pages, 2014.
View at: Publisher Site | Google Scholar
S. Fu and C. Zhang, “Adaptive non-convex total variation regularisation for image restoration,” Electronics Letters, vol. 46, no. 13, pp. 907–908, 2010.
View at: Publisher Site | Google Scholar
Y. Wang, W. Ren, and H. Wang, “Anisotropic second and fourth order diffusion models based on Convolutional Virtual Electric Field for image denoising,” Computers and Mathematics and Applications, vol. 66, no. 10, pp. 1729–1742, 2013.
View at: Publisher Site | Google Scholar
C. L. Wu and X. C. Tai, “Augmented Lagrangian method, dual methods, and split bregman iteration for ROF, vectorial TV, and high order models,” SIAM Journal on Imaging Sciences, vol. 3, no. 3, pp. 300–339, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
X.-C. Tai and C. L. Wu, “Augmented Lagrangian method, dual methods and split bregman iteration for ROF model,” in Scale Space and Variational Methods in Computer Vision: Second International Conference, SSVM 2009, Voss, Norway, June 1–5, 2009. Proceedings, vol. 5567 of Lecture Notes in Computer Science, pp. 502–513, Springer, Berlin, Germany, 2009.
View at: Publisher Site | Google Scholar
M. Elad and M. Aharon, “Image denoising via sparse and redundant representations over learned dictionaries,” IEEE Transactions on Image Processing, vol. 15, no. 12, pp. 3736–3745, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
W. Dong, L. Zhang, G. Shi, and X. Li, “Nonlocally centralized sparse representation for image restoration,” IEEE Transactions on Image Processing, vol. 22, no. 4, pp. 1620–1630, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Wang, C. Zhu, J. Zhang, and Y. Jian, “Convolutional virtual electric field for image segmentation using active contours,” PLoS ONE, vol. 9, no. 10, Article ID e110032, 2014.
View at: Publisher Site | Google Scholar
Z. Yang and M. Jacob, “Nonlocal regularization of inverse problems: a unified variational framework,” IEEE Transactions on Image Processing, vol. 22, no. 8, pp. 3192–3203, 2013.
View at: Publisher Site | Google Scholar
H. Wang, Y. Wang, and W. Ren, “Image denoising using anisotropic second and fourth order diffusions based on gradient vector convolution,” Computer Science and Information Systems, vol. 9, no. 4, pp. 1493–1511, 2012.
View at: Publisher Site | Google Scholar
Y. Wang, W. Chen, S. Zhou, T. Yu, and Y. Zhang, “MTV: modified total variation model for image noise removal,” Electronics Letters, vol. 47, no. 10, pp. 592–594, 2011.
View at: Publisher Site | Google Scholar
H. Zhang and Y. Wang, “Edge adaptive directional total variation,” The Journal of Engineering, 2 pages, 2013.
View at: Publisher Site | Google Scholar
L. Xu, C. Lu, Y. Xu, and J. Jia, “Image smoothing via L₀ gradient minimization,” ACM Transactions on Graphics, vol. 30, no. 6, article 174, 2011.
View at: Publisher Site | Google Scholar
N. K. Bose and N. A. Ahuja, “Superresolution and noise filtering using moving least squares,” IEEE Transactions on Image Processing, vol. 15, no. 8, pp. 2239–2248, 2006.
View at: Publisher Site | Google Scholar
Y. J. Lee, S. Lee, and J. Yoon, “A framework for moving least squares method with total variation minimizing regularization,” Journal of Mathematical Imaging and Vision, vol. 48, no. 3, pp. 566–582, 2014.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
A. Spira, R. Kimmel, and N. Sochen, “A short-time Beltrami kernel for smoothing images and manifolds,” IEEE Transactions on Image Processing, vol. 16, no. 6, pp. 1628–1636, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Wang, L. Liu, H. Zhang, Z. Cao, and S. Lu, “Image segmentation using active contours with normally biased GVF external force,” IEEE Signal Processing Letters, vol. 17, no. 10, pp. 875–878, 2010.
View at: Publisher Site | Google Scholar
J. Weickert, “Coherence-enhancing diffusion filtering,” International Journal of Computer Vision, vol. 31, no. 2, pp. 111–127, 1999.
View at: Publisher Site | Google Scholar
Y. Wang, J. Yang, W. Yin, and Y. Zhang, “A new alternating minimization algorithm for total variation image reconstruction,” SIAM Journal on Imaging Sciences, vol. 1, no. 3, pp. 248–272, 2008.
View at: Publisher Site | Google Scholar | MathSciNet
L. Zhang, P. Bao, and X. Wu, “Multiscale LMMSE-based image denoising with optimal wavelet selection,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, no. 4, pp. 469–481, 2005.
View at: Publisher Site | Google Scholar
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2015 Wenxue Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1599

Downloads

1352

Citations