A Modified Iterative Alternating Direction Minimization Algorithm for Impulse Noise Removal in Images

Guo, Di; Qu, Xiaobo; Wu, Meng; Wu, Keshou

doi:https://doi.org/10.1155/2014/595782

Journal of Applied Mathematics

On this page

Abstract Introduction Model Results Conclusions Acknowledgments References Copyright Related Articles

Special Issue

Iterative Methods and Applications 2014

View this Special Issue

Research Article | Open Access

Volume 2014 | Article ID 595782 | https://doi.org/10.1155/2014/595782

A Modified Iterative Alternating Direction Minimization Algorithm for Impulse Noise Removal in Images

Di Guo,¹Xiaobo Qu,²Meng Wu,³and Keshou Wu¹

Academic Editor: Filomena Cianciaruso

Received10 May 2014

Revised16 Jun 2014

Accepted16 Jun 2014

Published06 Jul 2014

Abstract

Images are often corrupted by impulse noise. In this paper, an alternating direction minimization with continuation algorithm is modified and iteratively used to remove the impulse noise in images by exploring its self-similarity. A patch-based nonlocal operator and sparse representation are married in the - optimization model to be solved. Simulation results demonstrate that the proposed algorithm outperforms typical denoising methods in terms of preserving edges and textures for both salt-and-pepper noise and random-valued impulse noise. It can be also applied to suppress impulse noise-like artifacts in real mural images.

1. Introduction

Image denoising is a fundamental problem in image processing. Besides the commonly processed Gaussian noise, impulse noise (Figure 1(a)) is another typical type of noise generated due to noisy sensors or channel transmission errors [1]. In mural images, the impulse noise-like artifacts are also observed because of the bacterial plaque (Figure 1(b)) or missing objects (Figure 1(c)). A classical impulse denoising method is median filtering, which replaces the central pixel with a median-value within a local window. Median filtering is with low computation but often loses image structures when noise is heavy. The denoising performance is expected to be greatly improved if the image structures are extracted and preserved in denoising.

(a)

(b)

(c)

In recent years, sparse representation method has attracted great attention to provide effective representation of image structures and found promising applications in image denoising [2–5], image decomposition [6, 7], image fusion [8, 9], pattern recognition [10–13], and so forth. In impulse noise removal, sparse representation is remarkably effective at smoothing away noise [14–16], but it may lose image structures which are not sparsely represented by its predefined basis such as wavelet [3, 14]. Although the adaptive dictionary training [15, 16] improves the denoising performance, its computation cost of training dictionaries while removing noise is relatively high. Besides, the commonly used total variation [17–20] is highly related to enforcing the sparsity of finite difference of images. However, total variation assumes that images are piecewise smooth; thus, textures would be easily lost after denoising [15, 16, 21, 22]. Therefore, exploring the sparse representation for impulse noise removal is still challenging.

Similarity is often rooted in repeated patterns of images [23–25] and greatly improves image quality in deblurring [26] and medical image reconstruction [27]. Similarity information was previously investigated in block matching 3D frames [26]. Patch-based nonlocal operator (PANO) [27] is a linear operator to model the sparse representation of similar patches, which can be viewed as an alternative form of the block matching 3D frames. Unlike the traditional sparsifying methods, for example, conventional wavelets or finite difference, PANO provides an adaptive sparse representation of image with a very fast training phase. Besides, the linearity of PANO allows setting up explicitly a sparsity-based denoising model.

The contributions of this paper are summarized as follows.(1)The impulse noise is removed by making use of similarity-motivated sparse representation of images. Mathematically, we model the denoising problem as an - minimization problem with PANO which provides the sparse representation of similar image patches.(2)To solve the optimization problem, a fast alternating direction minimization with continuation algorithm is developed by taking the patch-based representation property into account.(3)Besides removing salt-and-pepper noise and random-value impulse noise in images, the proposed method is also applied in recovering mural images from corrupted data. Experimental results on simulated data and real mural images verify that the proposed method outperforms other methods in removing impulse noise or impulse noise-like artifacts.

2. Model

In this section, the impulse noise model and typical denoising methods are briefly summarized. Then, the proposed denoising model is presented.

2.1. Impulse Noise

Image contaminated with impulse noise is usually modeled as where is the noiseless image, is the observation, denotes an element-wise product, is a sample drawn from an i.i.d. multivariate Bernoulli distribution with success probability , represents a vector with all elements being equal to one, is either salt-and-pepper noise or random-valued impulse noise.

For the salt-and-pepper noise, the element of satisfies where . For the random-valued impulse noise, is drawn from uniform distribution in . In this paper, , , and are set.

2.2. Proposed Denoising Model

With a maximum a posteriori estimator on the impulse noise and prior knowledge of image, the noiseless image is estimated by minimizing where can be chosen as total variation assuming that the image is piecewise constant [19, 28] or norm of wavelet coefficients assuming that the image is sparse in the wavelet domain [14]. However, total variation is observed to easily lose textures [16] and wavelet may lose image structures that are not sparsely represented by its predefined basis. Thus, how to preserve the edges and textures remains open for the impulse denoising problem.

In this paper, image self-similarity is employed to provide an optimized sparse representation of images. Assuming that the similarity information of image is known with PANO, an - regularization model is proposed to remove the impulse noise, where promotes the sparsity using PANO, removes the outliers in images, and balances between the sparsity and outliers removing.

PANO is a linear operator to model the sparse representation of similar patches [27, 29]. For a given image , PANO is defined as where denotes the patch extraction, means grouping some of the patches into a 3D cube, and is 3D Haar transform. Figure 2 illustrates the process of grouping patches into a cube. First, an image is extracted into patches. Then, some similar patches are grouped together and stacked into 3D cubes. Finally, a sparse representation will be achieved by performing a 3D Haar transform on each cube, where is the sparse vector for the th cube [27, 29]. The adjoint operator of is , and , where is a diagonal matrix whose th diagonal entry is a counter indicating the repetitions that the th pixel is grouped into the 3D cubes. Therefore, by taking this patch-based representation property into account, the traditional alternating direction algorithm can be derived to achieve fast computation.

(a)

(b)

(c)

3. Algorithm

To numerically solve the optimization problem in (4), an alternating direction minimization with continuation (ADMC) algorithm [30, 31] is modified to remove the impulse noise. ADMC algorithm is also used for image deblurring [32, 33]. Here, by introducing auxiliary variables and to (6), one has

As , the solution of (7) approaches that of (6). In practice, we use the previous solution as a “warm start” for the next alternating optimization as gradually increased. does not need to be very large for image denoising. Simulation results show that increasing it will not improve the quality of denoised image but need more computation time. Thus is suggested. When is fixed, (7) can be solved in an alternating fashion between , , and . Consider the following.(1)Fix and ; solve , whose solution is where denotes the soft thresholding operation on with threshold [30, 31].(2)Fix and ; solve , whose solution is (3)Fix and ; solve , whose solution is

To construct PANO, similarity needs to be learnt so that some similar patches are grouped together and stacked into 3D cubes. However, the similarity is corrupted for a noisy image. To obtain a reasonable similarity, we need to have an initial denoised image as a guide image. The similarity is first learnt from a denoised image using conventional methods such as median filtering and then learnt twice from the denoised image using PANO. The process of the modified algorithm is summarized as Algorithm 1.

Initialization:
Input the noise contaminated image , the PANO ,
regularization parameter , tolerance of inner loop , and times of
learning similarity is 3. Initialize , , for and .
Main:
Step 1. Obtain the initial guide image from median filtering [1];
While ,
Step 2. Learn similarity in PANO from the guide image [27];
While ,
Step 3. Solve (8);
Step 4. Solve (9);
Step 5. Solve (10);
Step 6. If , , go to Step 3;
otherwise, go to Step 7;
Step 7. , , go to Step 3.
End While
Step 8. , , , Go to Step 2;
End While
Output:

4. Results

In simulations, the proposed PANO-based denoising method is compared with median filtering [1], wavelet-based sparse representation denoising, and total variation denoising. The dual-tree complex wavelet, which was used in impulse denoising [14], is adopted as the wavelet transform. PANO is applied with the typical parameter settings: the number of similar patches is 16, the patch size is 8 × 8, and the search region is 39 × 39.

Objective image quality assessments, peak signal-to-noise ratio (PSNR), and mean measure of structural similarity (MSSIM) [34] are evaluated. The PSNR is defined as where is the number of pixels in an image and and are the original and denoised images, respectively. MSSIM is defined as where and are the image content at the th local window and SSIM evaluates local reconstruction errors by measuring the similarity between two images in a local window [34]. A higher MSSIM value means that structural information is better preserved and more suitable for human visual system.

The experiments run on 4 Cores 2.6 GHz CPU laptop computer with 12 GB RAM. The computational time of the proposed method is approximately 25 (or 70) seconds for image with size 256 × 256 (or 512 × 512). For the simulated noisy images, the window size of the median filtering and the regularization parameters of the rest methods are optimized to maximize MSSIMs while removing most of the impulse noise.

4.1. Choose Guide Images

The similarity is assumed to be known in the proposed denoising model. However, the similarity is also corrupted for a noisy image. To obtain a reasonable similarity, we need to have an initial denoised image as a guide image. In this section, we will discuss how to choose a guide image.

Since conventional denoising methods are available, one may consider taking the denoising result by median filtering, total variation, or wavelet denoising as the guide image to learn the similarity. When a better denoised image is obtained using the proposed approach, one may further utilize the result as an updated guide image.

As shown in Figure 3, different initial guide images lead to comparable denoising results with 30% noise. So median filtering is chosen to produce the initial guide image since its computation is the fastest. After the similarity is learnt for 3 times, both the PSNR and MSSIM of the proposed method become stable, and more similarity learning will cost more computation time. Hence, learning the similarity 3 times is sufficient.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

(j)

4.2. Remove Simulated Impulse Noise

Images (Figures 3(a), 4(a), and 4(d)), which are usually used in image processing, are treated as ground truth images; salt-and-pepper noise or random-valued impulse noise is manually added in simulations.

(a)

(b)

(c)

(d)

(e)

(f)

4.2.1. Salt-and-Pepper Noise Removal

The performances of the four denoising methods for salt-and-pepper noise are compared. As shown in Figure 5, repeated image patterns, for example, textures in Barbara, are obviously lost using median filtering and total variation. Although wavelet recovers the textures much better than the above two methods, it suffers from losing edges. The proposed method preserves these features best, with the clearest textures in Barbara and edges in both House and Boat.

As shown in Figure 6, the proposed method achieves the highest PSNRs when the noise level is below 40% and the highest SSIMs for all noise levels. When the noise becomes heavier (e.g., 50%), the performance of the proposed method gradually dropped. As Figure 7 shows, the qualities of the initial guide images using median filtering, total variation, and wavelet denoising methods are all unsatisfactory; thus, similarity cannot be learnt well so that the denoising results of the proposed method are also not satisfactory. Table 1 shows the performance of the proposed method using different initial guide images under heavy noise. Suppose we have the original image as the initial guide image so that similarity information can be exactly leant; the proposed method can remove the noise very well and preserve the image structures. In summary, the proposed method leads to comparable denoising results when ground truth image is not available.

(a)

(b)

(c)

(d)

(e)

(f)

4.2.2. Random-Valued Impulse Noise Removal

The performances of the four denoising methods for random-valued impulse noise are also compared. As shown in Figure 8, edges and textures are best preserved by the proposed method. Under different noise levels, proposed method achieves the highest MSSIMs (Figure 9). These observations imply that the proposed method preserves the best image structures during removing the random-valued impulse noise.

(a)

(b)

(c)

(d)

(e)

(f)

4.3. Remove Impulse Noise-Like Artifacts in Mural Images

In the section, the impulse noise-like artifacts in realistic mural images are suppressed using these denoising methods. As shown in Figure 10, both median filtering and total variation will easily blur the images. On the contrary, the proposed method preserves the image details much better and suppresses most the impulse noise-like artifacts as marked. We can observe that the lost image structures are minimal among these methods (Figure 11). Therefore, the proposed method can also be used to remove these impulse noise-like artifacts of real dataset.

4.4. The Effect of Noise Detectors

Noise detectors are very useful to improve the denoising performance of salt-and-pepper noise. Chan et al. [18] proposed to use a noise detector first and apply a weighted regularization model with less penalization on the noise-free pixels. Following this idea, we use a noise detector to distinguish the noisy pixels from the rest of the pixels in the preliminary results. The locations of detected noise candidates are stored in a set , whose complementary set stores locations of the rest of the pixels. We tried a weighted - regularization model as where is a diagonal matrix, whose th diagonal entry is . A small weight is assigned for noise candidates and a large weight is set for the rest of pixels. is chosen to be total variation or PANO.

Simulation results listed in Table 2 show that noise detectors can significantly improve the denoising performance. When both methods are equipped with noise detectors, the proposed method still outperforms total variation with higher MSSIMs and comparable PSNRs. This implies that the proposed method can preserve image structures better, as shown in Figure 12.

(a)

(b)

(c)

(d)

(e)

An efficient method to suppress the noise via combining PANO with noise detectors can be found in [35]. However, the noise detectors proposed in [18] only work for salt-and-pepper noise. How to detect the noise candidates in random-valued noisy image is still unknown. Besides, how to solve the proposed weighted regularization model efficiently and setting the weight optimally need comprehensive investigation. We leave these as the future work.

5. Conclusions

Impulse noise removal with similarity-motivated sparse representation is proposed. With a patch-based nonlocal operator to model sparse representation of similar image patches, the - optimization problem is solved by a modified iterative alternating direction minimization algorithm.

Experiments on simulated data demonstrate that the proposed method significantly improve the recovery of textures and edges while removing both salt-and-pepper noise and random-valued impulse noise. It can be also used to remove the impulse noise-like artifacts in mural images well. Denoising performance of the proposed method may be further improved if one can learn a proper similarity from serious noisy image.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China (61302174, 61201045), Scientific Research Foundation for the Introduction of Talent at Xiamen University of Technology (YKJ12021R), Open Fund from Key Lab of Digital Signal and Image Processing of Guangdong Province (2013GDDSIPL-07, 54600321), Fundamental Research Funds for the Central Universities (2013SH002), and Natural Science Foundation of Shaanxi Province of China (2013JM8015).

References

R. C. Gonzalez and E. Richard, Digital Image Processing, Prentice-Hall, 2002.
M. Elad and M. Aharon, “Image denoising via sparse and redundant representations over learned dictionaries,” IEEE Transactions on Image Processing, vol. 15, no. 12, pp. 3736–3745, 2006.
View at: Publisher Site | Google Scholar
L. Jacques, L. Duval, C. Chaux, and G. Peyré, “A panorama on multiscale geometric representations, intertwining spatial, directional and frequency selectivity,” Signal Processing, vol. 91, no. 12, pp. 2699–2730, 2011.
View at: Publisher Site | Google Scholar
L. Bao, M. Robini, W. Liu, and Y. Zhu, “Structure-adaptive sparse denoising for diffusion-tensor MRI,” Medical Image Analysis, vol. 17, no. 4, pp. 442–457, 2013.
View at: Publisher Site | Google Scholar
D. Huang, L. Kang, Y. Wang, and C. Lin, “Self-learning based image decomposition with applications to single image denoising,” IEEE Transactions on Multimedia, vol. 16, pp. 83–93, 2014.
View at: Publisher Site | Google Scholar
J. Starck, M. Elad, and D. L. Donoho, “Image decomposition via the combination of sparse representations and a variational approach,” IEEE Transactions on Image Processing, vol. 14, no. 10, pp. 1570–1582, 2005.
View at: Publisher Site | Google Scholar | Zentralblatt MATH
L.-W. Kang, C.-W. Lin, and Y.-H. Fu, “Automatic single-image-based rain streaks removal via image decomposition,” IEEE Transactions on Image Processing, vol. 21, no. 4, pp. 1742–1755, 2012.
View at: Publisher Site | Google Scholar
P. Wang, H. Tian, and W. Zheng, “A novel image fusion method based on FRFT-NSCT,” Mathematical Problems in Engineering, vol. 2013, Article ID 408232, 9 pages, 2013.
View at: Publisher Site | Google Scholar
L. Xu, J. Du, and Q. Li, “Image fusion based on nonsubsampled contourlet transform and saliency-motivated pulse coupled neural networks,” Mathematical Problems in Engineering, vol. 2013, Article ID 135182, 10 pages, 2013.
View at: Publisher Site | Google Scholar
J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, “Robust face recognition via sparse representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210–227, 2009.
View at: Publisher Site | Google Scholar
H. Cheng, Z. Liu, L. Yang, and X. Chen, “Sparse representation and learning in visual recognition: theory and applications,” Signal Processing, vol. 93, no. 6, pp. 1408–1425, 2013.
View at: Publisher Site | Google Scholar
C. Lin, B. H. Wang, X. F. Zhao, and M. Pang, “Optimizing kernel PCA using sparse representation-based classifier for mstar SAR image target recognition,” Mathematical Problems in Engineering, vol. 2013, Article ID 847062, 10 pages, 2013.
View at: Publisher Site | Google Scholar
H. Cheng, Z. Liu, L. Hou, and J. Yang, “Sparsity induced similarity measure and its applications,” IEEE Transactions on Circuits and Systems for Video Technology, no. 99, 1 pages, 2013.
View at: Publisher Site | Google Scholar
S. Huang and J. Zhu, “Removal of salt-and-pepper noise based on compressed sensing,” Electronics Letters, vol. 46, no. 17, pp. 1198–1199, 2010.
View at: Publisher Site | Google Scholar
Q. Liu, S. Wang, J. Luo, Y. Zhu, and M. Ye, “An augmented Lagrangian approach to general dictionary learning for image denoising,” Journal of Visual Communication and Image Representation, vol. 23, no. 5, pp. 753–766, 2012.
View at: Publisher Site | Google Scholar
S. Wang, Q. Liu, Y. Xia et al., “Dictionary learning based impulse noise removal via L1-L1 minimization,” Signal Processing, vol. 93, no. 9, pp. 2696–2708, 2013.
View at: Publisher Site | Google Scholar
M. Nikolova, “A variational approach to remove outliers and impulse noise,” Journal of Mathematical Imaging and Vision, vol. 20, no. 1-2, pp. 99–120, 2004.
View at: Publisher Site | Google Scholar | MathSciNet
R. H. Chan, H. Chung-Wa, and M. Nikolova, “Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization,” IEEE Transactions on Image Processing, vol. 14, no. 10, pp. 1479–1485, 2005.
View at: Publisher Site | Google Scholar
J. Cai, R. H. Chan, and C. Di Fiore, “Minimization of a detail-preserving regularization functional for impulse noise removal,” Journal of Mathematical Imaging and Vision, vol. 29, no. 1, pp. 79–91, 2007.
View at: Publisher Site | Google Scholar
J. Cai, R. H. Chan, and M. Nikolova, “Fast two-phase image deblurring under impulse noise,” Journal of Mathematical Imaging and Vision, vol. 36, no. 1, pp. 46–53, 2010.
View at: Publisher Site | Google Scholar
X.-G. Lv, J. Le, J. Huang, and L. Jun, “A fast high-order total variation minimization method for multiplicative noise removal,” Mathematical Problems in Engineering, vol. 2013, Article ID 834035, 13 pages, 2013.
View at: Publisher Site | Google Scholar
Y. Shi and Q. Chang, “Efficient algorithm for isotropic and anisotropic total variation deblurring and denoising,” Journal of Applied Mathematics, vol. 2013, Article ID 797239, 14 pages, 2013.
View at: Publisher Site | Google Scholar
A. Buades, B. Coll, and J. M. Morel, “A review of image denoising algorithms, with a new one,” Multiscale Modeling and Simulation, vol. 4, no. 2, pp. 490–530, 2005.
View at: Publisher Site | Google Scholar | Zentralblatt MATH
K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, “Image denoising by sparse 3-D transform-domain collaborative filtering,” IEEE Transactions on Image Processing, vol. 16, no. 8, pp. 2080–2095, 2007.
View at: Publisher Site | Google Scholar
J. V. Manjón, P. Coupé, A. Buades, D. Louis Collins, and M. Robles, “New methods for MRI denoising based on sparseness and self-similarity,” Medical Image Analysis, vol. 16, no. 1, pp. 18–27, 2012.
View at: Publisher Site | Google Scholar
Y. K. Hou, C. X. Zhao, D. Y. Yang, and Y. Cheng, “Comments on image denoising by sparse 3-D transform-domain collaborative filtering,” IEEE Transactions on Image Processing, vol. 20, no. 1, pp. 268–270, 2011.
View at: Publisher Site | Google Scholar
X. Qu, Y. Hou, F. Lam, D. Guo, J. Zhong, and Z. Chen, “Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator,” Medical Image Analysis, vol. 18, pp. 843–856, 2014.
View at: Google Scholar
P. Rodriguez, “Total variation regularization algorithms for images corrupted with different noise models: a review,” Journal of Electrical and Computer Engineering, vol. 2013, Article ID 217021, 18 pages, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
X. Qu, Y. Hou, F. Lam, D. Guo, and Z. Chen, “Magnetic resonance image reconstruction using similarities learnt from multi-modal images,” in Proceedings of the IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP '13), pp. 264–268, IEEE, Beijing, China, 2013.
View at: Google Scholar
J. Yang, Y. Zhang, and W. Yin, “A fast alternating direction method for TVL1-L2 signal reconstruction from partial Fourier data,” IEEE Journal on Selected Topics in Signal Processing, vol. 4, no. 2, pp. 288–297, 2010.
View at: Publisher Site | Google Scholar
X. Qu, D. Guo, B. Ning et al., “Undersampled MRI reconstruction with patch-based directional wavelets,” Magnetic Resonance Imaging, vol. 30, no. 7, pp. 964–977, 2012.
View at: Publisher Site | Google Scholar
Y. M. Huang, M. K. Ng, and Y. W. Wen, “A fast total variation minimization method for image restoration,” Multiscale Modeling & Simulation, vol. 7, no. 2, pp. 774–795, 2008.
View at: Publisher Site | Google Scholar
X. X. Guo, F. Li, and M. K. Ng, “A fast $l_{1}$ -TV algorithm for imgage restoration,” SIAM Journal on Scientific Computing, vol. 31, pp. 2322–2341, 2009.
View at: Google Scholar
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004.
View at: Publisher Site | Google Scholar
D. Guo, X. Qu, X. Du, K. Wu, and X. Chen, “Salt and pepper noise removal with noise detection and a patch-based sparse representation,” Advances in Multimedia, vol. 2014, Article ID 682747, 14 pages, 2014.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2014 Di Guo et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1112

Downloads

1290

Citations