Abstract

A combined total variation and high-order total variation model is proposed to restore blurred images corrupted by impulse noise or mixed Gaussian plus impulse noise. We attack the proposed scheme with an alternating direction method of multipliers (ADMM). Numerical experiments demonstrate the efficiency of the proposed method and the performance of the proposed method is competitive with the existing state-of-the-art methods.

1. Introduction

Image restoration is one of the most fundamental tasks in image processing and plays an important role in various areas of applied sciences [1]. In the literature of image restoration, there exist a lot of good methods dealing with images which are contaminated by single kind of noise, such as additive Gaussian noise or impulse noise. However, in many practical situations, the observed images are usually corrupted by mixed noise, for example, Gaussian plus impulse noise and Gaussian plus Poisson noise. In this work, we focus on Gaussian plus impulse noise. This kind of mixed noise is commonly caused by malfunctioning arrays in camera sensors or transmission errors [2]. We aim to find the unknown true image from the observed image defined by where denote the process of image degradation with impulse noise, is a blurring matrix which is assumed to be known, and is an additive zero-mean Gaussian white noise of variance . For simplicity and without loss of generality, we assume that the underlying images have square domains. Based on the noise values, impulse noise can be classified as salt-and-pepper noise and random-valued noise. Suppose that is the dynamic range of and () is the gray value of an image at location [3]. The operator is defined as follows.

(i) Salt-and-pepper noise: the gray level of at pixel location is  where is the noise ratio which defines the level of the salt-and-pepper noise.

(ii) Random-valued noise: the gray level of at pixel location is  where are uniformly distributed random numbers in and is the noise ratio which defines the level of the random-valued noise.

It is obvious that it is more difficult to remove the random-valued impulse noise than salt-and-pepper noise since the random-valued impulse noise can be arbitrary number in . As is well known, recovering form is an ill-conditioned problem. A general approach to compute a meaningful approximation is the regularization method. Recently, variational models have attracted a lot of interest in cleaning mixed noise [39]. The key idea of these methods is based on a two-approach: detect the location of the impulse corrupted pixels then proceed with the filtering phase. For example, Cai et al. [4] proposed a two-phase approach for (1). In the first phase, they identify the location of the impulse noise and remove them from the data set through median filter. In the second phase, they minimize a functional of the form where is the set of data samples that are likely to be uncorrupted with impulse noise and is the Mumford-Shah regularization term [10]: where is the edge set. Due to nonconvexity of Mumford-Shah regularizer, there exist numerous local minimums of (4). It is difficult to handle the Mumford-Shah functional. To overcome this difficulty, the -convergence functional for is used in [4]. The reconstruction performance is competitive; however the choice of or in (4) is depending on noise level and the computational performance is poor. In [5], Cai et al. accelerate the method in [4] and the computational time is much less than that in [4], although it is still highly depending on noise level. Recently, Li et al. [9] considered a functional with a content-dependent fidelity term and then proposed an iterative framelet-based approximation deblurring algorithm IFASDA. The advantage of IFASDA is that this algorithm is parameter free, which makes the proposed method more practical. We note that the total variation (TV) is not used in [4, 9]; however, the TV regularization is very popular [11] as its superiority of preserving sharp edges or object boundaries in the recovered images. The modified total variation minimization scheme is proposed in [3] to restore the images and an alternating minimization algorithm is employed to solve the proposed problem. In [8], a cost functional consisting of TV regularization term and and data fidelity terms is proposed to remove mixed Gaussian plus impulsive noise. Their numerical experiments showed that their method was very efficient and the reconstruction performance was quite competitive. However, as we know the TV norm transforms the smooth area to piecewise constants, the so-called staircase effect. In order to overcome this spurious effect, many high-order PDEs have been proposed [1214] to solve this problem. Motivated by this, we propose a new model combining total variation and high-order total variation to restore the blurred images corrupted by Gaussian plus impulse noise. Our numerical experiments show the effectiveness of the proposed approach.

The outline of this paper is as follows. In Section 2, we briefly introduce the work of Huang et al. in [3] and the alternating direction method of multipliers (ADMM). In Section 3, we present the proposed algorithm. To demonstrate the effectiveness of the proposed method, we will show some numerical results on several test images in Section 4. Finally, some conclusion remarks are drawn in Section 5.

2.1. Review of Current Methods

In [3], Huang et al. proposed the following modified total variation minimization scheme to restore the blurred images corrupted by Gaussian plus impulse noise: where is the set of data samples that are likely to be uncorrupted by impulse noise, (or 2), and are two positive regularization parameters, and is the discrete total variation (TV) regularization term. The discrete TV of is defined by . The discrete gradient operator is defined by with for . Here refers to the th entry of the vector (it is the th pixel location of the image). In [3], the median-type filter was used to identify the location of the possible noisy pixels in the first phase; then problem (6) was solved by alternating minimization method with respect to and . As reported in [3], they used the norm in the experiment, and the restoration results by using norm were about the same as those by using the norm for impulse plus Gaussian noise condition.

2.2. The Alternating Direction Method of Multipliers (ADMM)

In this section, we present the alternating direction method of multipliers (ADMM) [1517] which belongs to the family of augmented Lagrangian methods. Consider the following linearly constrained separable convex minimization problem of the form: where and are closed proper convex functions, and are closed convex sets, and are given matrices, and is a given vector. Specifically, the iterative scheme of ADMM for solving (8) is as follows.

Algorithm ADMM(1)Set   and choose , , and (2)repeat (3),(4), (5),(6),(7)until stopping criterion is satisfied.

As reported in [18], the penalty parameter can be substituted by a symmetric positive definite (spd) matrix and the extension of ADMM is still convergent. This leads to the following extension of algorithm ADMM.

Extension of Algorithm ADMM(1)Set   and choose , , and , (2)repeat (3),(4),(5),(6), (7)until stopping criterion is satisfied.

3. The Proposed Approach

Throughout this paper, we will assume that the set of outlier (pixels corrupted with impulse noise) is known. Actually, we can use the adaptive median filter (AMF) [19] to detect salt-and-pepper noise and the adaptive center-weighted median filter (ACWMF) [20] for random-valued impulse noise case. Using the set represents the data samples that are likely to be uncorrupted by impulse noise; then we proposed the following objective function; where , is the indicator function, (or 2), and [12]. For simplicity we introduce the notation . Then we will discuss the details of the algorithm to solve the model (9). For convenience we introduce three new variables and rewrite (9) in the constrained optimization problem as follows:

We apply the extension of ADMM algorithm to the constrained problem (10), which we call mixed noise image deblurring by extension of ADMM (MNID-ADMM). In the following algorithm, we can simply choose positive matrix as , where is the identity matrix. If we set , it is known as ADMM algorithm.

Algorithm of MNID-ADMM(1)Set  , , and choose , and positive matrix , (2)repeat(3),(4), (5),(6), (7),, ,(8),(9)until stopping criterion is satisfied.

Cai et al. [4] considered to use ( or ) as the data-fidelity term and discussed how to choose or norm. It is known that data-fidelity term is more suitable than data-fidelity when applying to remove impulse noise [21, 22]. From an experimental point of view, we find that it is faster to use norm than norm. Considering this, we use data-fidelity term when the images are corrupted by mixed Gaussian plus impulse noise and we use data-fidelity term when the images are corrupted by impulse noise only. Then, we will discuss the details of solving the , , , and subproblems, respectively. For subproblem, when , it is easy to solve the subproblem through shrinkage and the minimizer is given by When , the minimizer is given by . There are numerous algorithms to solve the subproblem [11, 2325]; here, we consider adopting Chambolle’s algorithm [25]. The minimizer is given by where . In order to get , we need to solve the following problem:

In image restoration, is usually a matrix of special structure. For example, is a block-circulant with circulant block (BCCB) matrix when periodic boundary conditions are applied to the image boundary. The matrix can be diagonalized by the discrete fast Fourier transform (FFT) matrix. There are some fast algorithms to solve the problem (13) for different boundary conditions. In this paper, we use periodic boundary conditions. Then the solution of subproblem (13) can be exactly and efficiently calculated via fast Fourier transform.

4. Numerical Results

In this section, numerical experiments are presented to demonstrate the performance of our proposed MNID-ADMM for test images “Lena,” “Einstein,” “Cameraman,” and “Boat.” All test images are gray level images. The results are compared with those obtained by the two-phase method denoted by “Cai-TP” [4] and the fast restoration method proposed in [3]. The splitting-and-penalty method is employed to solve the modified total variation scheme in [3]. As we know, the ADMM approach is more efficient and stable than the splitting-and-penalty method [26, 27]. For a fair comparison, we solve the total variation scheme (just set in (9)) by ADMM rather than the splitting-and-penalty method used in [3]. For simplicity, we call this method “HADMM” hereafter. In order to measure the quality of the restored images by different methods, we introduce the mean squared error (MSE), and the peak signal-to-noise ratio (PSNR): where , , and are the original image, the blurred image, the number of pixels of image, and the maximum possible pixel value of the image, respectively. The higher PSNR, the better quality of the restoration. All the experiments are performed using MATLAB 7.10.0 on a computer equipped with an Intel(R) Pentium(R) 2.80 GHz processor, with 4.00 GB of RAM, and running Windows 7. The stop criterion of all methods is set to be . In order to reduce the computational time in the search for good regularization parameters, we set for impulse noise only situation. It is reasonable to set ; for further details, see [12]. Moreover, we find that we can get good restoration result by just setting for impulse plus Gaussian noise situation. An out-of-focus kernel with radius 3 is used to blur the original images in the following examples. The parameters were hand tuned to give the best PSNR improvement. Similarly as in [4], we also use the same parameters for different images for the same convolution kernel and noise level.

Example 1. We restore images contaminated by impulse noise only. In this example, we consider the images corrupted by salt-and-pepper noise with level of 70% and random-valued noise with level of 55% separately. The four original images and the blurred images are shown in Figure 1. The comparisons of MNID-ADMM, Cai-TP, and HADMM methods are shown in Figures 2 and 3 and Table 1. From the restoration results, we get that the MNID-ADMM method performs better than Cai-TP both in restoration quality and computation times and we get a little higher PSNR than HADMM method for various images.

Example 2. We restore “Lena” contaminated by Gaussian noise of variance plus impulse noise with different level. The blurred and restored images by MNID-ADMM are shown in Figure 4 and the results are shown in Table 2. These results show that our proposed method can restore corrupted image with various noise level efficiently and the restore quality is quite well.

Example 3. We restore different images contaminated by Gaussian noise of variance plus impulse noise with different level. The blurred and restored images by MNID-ADMM are shown in Figures 5 and 6, and the results are shown in Tables 3 and 4. From the experiments results, we conclude that the proposed method can restore different images with various noise level quite well with the same parameters.

5. Conclusion

In this paper, a high-order total variation scheme is proposed to restore blurred images corrupted by Gaussian plus impulse noise. The alternating direction method of multipliers (ADMM) is employed to solve the proposed problem. Numerical examples demonstrate that the proposed model efficiently removes the mixed Gaussian plus impulse noise meanwhile avoids staircase effect. The proposed method can be extended to solve blind convolution problems. One of the difficulties in this paper is how to choose appropriate parameters and an adaptive parameter chosen method may be used in this method. These are future works.

Acknowledgments

This research is supported by 973 Program (2013CB329404), NSFC (61170311), and Sichuan Province Science and Technology Research Project (2012GZX0080).