Research Article  Open Access
Image Restoration by a Mixed HighOrder Total Variation and Regularization Model
Abstract
Total variation regularization is wellknown for recovering sharp edges; however, it usually produces staircase artifacts. In this paper, in order to overcome the shortcoming of total variation regularization, we propose a new variational model combining highorder total variation regularization and regularization. The new model has separable structure which enables us to solve the involved subproblems more efficiently. We propose a fast alternating method by employing the fast iterative shrinkagethresholding algorithm (FISTA) and the alternating direction method of multipliers (ADMM). Compared with some current stateoftheart methods, numerical experiments show that our proposed model can significantly improve the quality of restored images and obtain higher SNR and SSIM values.
1. Introduction
Image restoration is an important and fundamental problem in the literature of image processing. It is widely used in many fields, such as machine identification, biomedicine, astronomy, and medical imaging [1–4]. The purpose of image restoration is to get a better visual image from the degraded image. There are many factors that cause image degradation, for instance, atmospheric turbulence, camera shake, and the relative motion between an imaging device and an object [5].
The typical representation of image degradation is the blurring and additional noise of image. The original model of image degradation can generally be defined aswhere is an original image, is a blur operator, is an additive noise, and is a degraded image. Our aim is to recover from , which is known as deconvolution or deblurring.
Recovering from is a typically illposed problem. So we cannot solve it simply by using the normal leastsquares method. In order to overcome the illcondition of the problem, adding some regularization terms to the energy functional is usually adopted. One of the commendable regularization methods is Tikhonov regularization [6]. However, this method often tends to make images overly smooth and fails to preserve image details. In order to overcome this shortcoming, in 1992, replacing norm of with the TVnorm of , Rudin, Osher, and Fatemi in [7] introduced the following famous RudinOsherFatemi (ROF) model:where denotes the Euclidean norm, the first term of (2) is called fidelity term, and is the total variation regularization term. is a positive regularization parameter which controls the tradeoff between the first and second terms. The isotropic discrete total variation regularization term can be defined as where denotes the discrete gradient operator which is defined as follows: with for . Here refers to the entry of the vector . It is the pixel location of the image; see [8].
As well known, TV function is nondifferentiable and nonlinear; it is difficult to solve the ROF model (2). A number of efficient and robust methods are proposed to solve the ROF model. In [7], by seeking the steadystate solution of a parabolic PDE, Rudin et al. proposed a time marching scheme to solve the associated EulerLagrange equation of (2). In [8, 9], a lagged diffusivity fixed point iteration method was proposed to solving the same problem. Later, Newton’s method [10–15] and Chambolle’s projection algorithm [16–18] were proposed. Another class of algorithms for TV problems are the iterative shrinkage/thresholding (IST) algorithms, which are independently proposed and analyzed by several authors in different fields [19–24]. Recently, some firstorder optimization methods were proposed, such as fast TV deconvolution algorithm (FTVd) [25], augmented Lagrangian method (ALM), and split Bregman method [26–29]. Alternating direction method (ADM) [30–32], which is a variant of the ALM, goes back to the work of Gabay and Mercier [33]. The ADM was first studied extensively in variational optimization problems and then introduced to the fields of image processing [30, 31]. There are also many other methods for image restoration, such as partial differential equation (PDE) based methods [34–40] and the neural network methods [41, 42].
Recently, to further study the solving methods for ROF model, Huang et al. [46] introduced a new auxiliary variable and proposed a fast total variation minimization method as follows:where , are positive regularization parameters. The main purpose of this model (6) is to realize the separation of denoising and deblurring steps. The authors solved system (6) by an alternating minimization algorithm. The experimental results show the effectiveness of their method. In the process of image processing, there are some abnormal values, such as the sudden jump of pixels in a certain area. However, regularization is less sensitive to abnormal values and promotes sparse solutions. In [44], an unconstrained regularized minimization problem was proposed:where , , are positive regularization parameters. Due to and norm used in model (7), the experimental results show a good recovery effect.
It has been shown in [47, 48] that total variation methods can realize significantly sharper edges and overall more visually pleasing images. However, on the other hand, they tend to create piecewiseconstant images even in regions with smooth transitions of grey or color values in the original image. The undesired artifact is usually called staircase effect. Staircase solution fails to satisfy the evaluation of visual quality and develops false edges that do not exist in the true image.
To overcome the adverse effects in the application of image processing, a popular method is to replace the TV norm by a higherorder TV norm [45, 49–52]. Lysaker et al. first proposed secondorder total variation regularizer in [53] for additive noise removal in the process of medical image processing. Their method shows robustness in the protection of the edges. Later, a secondorder model to substantially reduce the staircase effect was proposed by Chan et al. in [48]. In particular, the secondorder TV regularization schemes are widely studied to overcome the staircase effects while preserving the edges well in the restored image.
Recently, Lv et al. in [45] proposed a highorder total variation minimization model:where , are positive regularization parameters and denotes higherorder total variation. The minimization model can reduce the staircase effect in the process of image restoration. The authors adopted an alternating minimization algorithm to solve the highorder minimization problem (8). Their experimental results showed that the proposed method gave the restored images with higher quality than some existing firstorder total variation restoration methods.
Motivated by the works of [44–46], we propose a new unconstrained minimization model:where , , and are positive regularization parameters. The definition of secondorder total variation is similar to the definition of the firstorder one: where denote the secondorder discrete gradient of the entry of the vector . For more details about the secondorder difference, refer to [54]. The secondorder TV regularization and regularization are used; the edges in the restored image can be preserved quite well and the staircase effect is reduced simultaneously. An alternating minimization method is used to solve the new unconstrained minimization model (9). By comparing with the other existing methods about total variation, our numerical experiments show the effectiveness of the minimization model (9).
The rest of this paper is organized as follows. In Section 2, we propose our alternating minimization algorithm to solve model (9), which is based on the fast iterative shrinkagethresholding algorithm (FISTA) and the alternating direction method of multipliers (ADMM). In Section 3, we give some numerical results to demonstrate the effectiveness of the proposed algorithm. Finally, concluding remarks of this paper are given in Section 4.
2. Alternating Minimization Method
In this section, we apply the ADMM idea to derive an algorithm for solving problem (9). We first introduce an auxiliary variable to transform problem (9) into an equivalent constrained optimization problem,and then minimize the augmented Lagrangian function of problem (11) by using the fast iterative shrinkagethresholding algorithm and the alternating direction multiplier method.
For the above constrained optimization problem (11), its augmented Lagrange function is defined byThen, using the alternating minimization method to solve problem (12) can be expressed as follows:
Fixing , , the subproblem can be obtained by solving the following minimization problem. Recently, various acceleration techniques of iterative algorithms are proposed [55–63]. For this subproblem, in order to accelerate the convergence of the above iteration, we adopt the acceleration technique in [55] to solve it.where is a Lipschitz constant [55], and . So, the minimizer of is given by the onedimensional shrinkage:
Fixing , , the subproblem for is equivalent to According to [64], the solution of can be obtained by the twodimensional shrinkage:where the convention is followed.
Fixing , the subproblem for can be written as follows:We can get the exact minimizer solution from the optimal conditions of (19) as follows:where refers to the firstorder difference operator and is the adjoint of . represents the identity matrix. Assuming that the problem satisfies the periodic boundary condition, then is block circulant matrix [65, 66], which can be diagonalized by the twodimensional discrete Fourier transform. So, by using the convolution theorem, we getwhere “” denotes complex conjugacy, “” denotes componentwise multiplication, , and is the inverse Fourier transform.
Finally, we update Lagrange multiplier :Our method in this paper can be described as shown in Algorithm 1.
3. Numerical Experiments
In this section, we present some numerical examples of image restoration to illustrate the effectiveness of our proposed approach. In our experiments, we compare the proposed algorithm with the other three stateoftheart methods, namely, FCP [44], highorder TV [45], and SALSA [43], under three different blurring operators. All experiments are performed under Windows 10 and MATLAB 2012a running on a desktop with an Intel® Core i5 Duo central processing unit at 2.50 GHz and 4 GB memory. The signaltonoise ratio (SNR), the structural similarity index measurement (SSIM) [67], and the blurred signal to noise ratio (BSNR) are employed to measure the quality of the restored images by different algorithms. They are defined as follows: where , , and are the original image, the restored image, and the noise vector added in the test, respectively. is the mean intensity value of , and are the mean value of and , respectively. and are the variance of and , respectively. And is covariance of and . and are constants. The SSIM is an index used to measure the similarity between restored image and ideal image. The closer the SSIM value to 1, the better the restored image.
Three classical grayscale images, named, “Lena” (256 256), “Man” (512 512), and “Cameraman” (256 256), are used as the test images and shown in Figure 1. To make it easier to compare different methods, we set as the stopping criterion in all experiments.
(a) Lena
(b) Man
(c) Cameraman
3.1. Parameters Settings
In this subsection, we discuss the selection of the three regularization parameters , , and in our method. In order to explain how to choose parameters in our algorithm, we recover the “Lena” image, which is blurred by Gaussian blur with size “9 9” and added the Gaussian white noise with BSNR=35. The influence of different , , and on the restoration image is explained in Figure 2. As shown in Figure 2, if is too small, the restored image will be overly smoothed with smeared image details. In contrast, the restored image will be dominated by noise component with larger values. We can see from Figures 2(e) and 2(f) that when the parameter changes within a certain range, there is little effect on image restoration. The parameter has the same effect as the one of has. The restored image will be overly smoothed with small values and dominated by noise component with larger values. The parameters , , and in our method are manually adjusted to the optimal value. Therefore, the parameters used in the tests will be illustrated in the following experiments.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
3.2. Gaussian Blur
In this example, we consider the Gaussian blur. The “Man” image shown in Figure 3(b) is degraded by Gaussian blur. The function has two parameters: bandwidth and standard deviation . In the test, we choose . We added Gaussian noise with BSNR = 35 to the test image. The parameters and are selected in SALSA. The parameters , , and are selected in our method. The parameters , , and are used in FCP method. For the highorder TV method, the parameters and are selected. The restored images obtained by SALSA [43], FCP [44], highorder TV [45], and our method are shown in Figures 3(c)–3(f). The changing curve of SNR of the reconstructed image during the experiment is shown in Figure 4. It can be seen from the changing graph that our method can get higher SNR than the other three methods. In Table 1, we list the restoration results of the four different methods in SNRs and SSIMs. From Figures 3(c)–3(f), we can see that the SALSA method can make restoration image smooth, the FCP method causes staircase effect, and our method can induce sparse structure of the image compared with the highorder TV method. The visual quality of the restored image by our method is better than the other three methods. More precisely, the same regions of image are zoomed and processed in the same way; they are presented in Figure 5. It is not difficult to see that our method has some advantages over the other three methods in eliminating the staircase effect.

(a)
(b)
(c)
(d)
(e)
(f)
(a)
(b)
(c)
(d)
(e)
(f)
3.3. Average Blur
In this example, we choose “Cameraman” image with size as an object of study. The image is degraded by average kernel with window size 11 and contaminated by the Gaussian noise with BSNR = 40, which is shown in Figure 6(b). In this example, we choose the parameters and for SALSA method. The parameters ,, and are used in our method. The parameters , , and are selected in FCP method. For highorder TV, the parameters and are used. Figures 6(c)–6(f) represent the restored images by SALSA, FCP, highorder TV, and our method, respectively. The change of SNR of the reconstructed image during the experiment is shown in Figure 7. The experimental results on SNR and SSIM are shown in Table 1. We see that both the SNR and SSIM values of the restored image by our method are higher than those provided by the SALSA [43], FCP [44], and highorder TV [45] method. The quality of restored images by our method is better than the other three methods.
(a)
(b)
(c)
(d)
(e)
(f)
Our method has some advantages in detail processing. In Figure 6, we have enlarged some details of image. The recovery results are presented in Figures 8(b)–8(e). Obviously, our method can well overcome the staircase effect and retain more image details.
(a)
(b)
(c)
(d)
(e)
(f)
3.4. Disk Blur
For this experiment, we consider the wellknown “Lena” as the test image. The image is corrupted by the Gaussian noise with BSNR = 35. The PSF for the linear disk blur represented a line segment of radius . In this experiment, we select . The original image and the observed image are shown in Figures 9(a) and 9(b). The parameters , , and are selected in our method. In parameters, we set and for SALSA method. The parameters , , and are used in FCP method. For the highorder TV method, the parameters and are selected. The restored images by the SALSA, FCP, highorder TV, and our method are shown in Figures 9(c)–9(f). In Figure 10, we plot the changes of SNR value versus iteration number for the four methods. Figure 11 shows the enlarged results of a part of Figure 9. The values of SNR and SSIM are listed in Table 1. We can see that our method can reduce the staircase effect effectively while preserving the edges.
(a)
(b)
(c)
(d)
(e)
(f)
(a)
(b)
(c)
(d)
(e)
(f)
We can see from the above three experiments that the images restored by our method have better qualities with less staircase effect and more detail textures than the other three methods. In order to further verify the effectiveness of our method, for the same experiment, we tested all the images which are listed in Figure 1, and the experimental results are shown in Table 1. We can find from the experimental results that the SNR and SSIM values obtained by our method are higher than the other three methods.
4. Conclusion
In this paper, by combining highorder total variation regularization and regularization, we propose a new variational model. Numerical experiments show that our method can overcome the staircase effects while preserving edges of the restored image. We also show that our proposed method can obtain better results than the three stateoftheart methods with higher SSIM and SNR values.
Data Availability
The test images in the article can be freely downloaded from this site “http://sipi.usc.edu/database/”.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was supported by the Training Program of the Major Research Plan of National Science Foundation of China under Grant 91746104, by National Science Foundation of China under Grant 61101208 and Grant 11326186, by Qingdao Postdoctoral Science Foundation, China (2016114), by a project of Shandong Province Higher Educational Science and Technology Program, China (J17KA166), and by Joint Innovative Center for Safe and Effective Mining Technology and Equipment of Coal Resources, Shandong Province of China, and SDUST Research Fund (2014TDJH102).
References
 H. Tanaka, T. Hayashi, and T. Nishi, “Application of digital image analysis to pattern formation in polymer systems,” Journal of Applied Physics, vol. 59, no. 11, pp. 3627–3643, 1986. View at: Publisher Site  Google Scholar
 T. Li, X. Li, J. Wang et al., “Nonlinear sinogram smoothing for lowdose Xray CT,” IEEE Transactions on Nuclear Science, vol. 51, no. 5, pp. 2505–2513, 2004. View at: Publisher Site  Google Scholar
 M. Chen and G. Li, “Forming mechanism and correction of CT image artifacts caused by the errors of three system parameters,” Journal of Applied Mathematics, vol. 2013, Article ID 545147, 7 pages, 2013. View at: Publisher Site  Google Scholar
 Y. Chen, Y. Guo, Y. Wang, D. Wang, C. Peng, and G. He, “Denoising of Hyperspectral Images Using Nonconvex Low Rank Matrix Approximation,” IEEE Transactions on Geoscience and Remote Sensing, vol. 55, no. 9, pp. 5366–5380, 2017. View at: Publisher Site  Google Scholar
 H. Chen, C. Wang, Y. Song, and Z. Li, “Split Bregmanized anisotropic total variation model for image deblurring,” Journal of Visual Communication and Image Representation, vol. 31, pp. 282–293, 2015. View at: Publisher Site  Google Scholar
 A. N. Tikhonov and V. Y. Arsenin, Solution of IllPosed Problems, Winston, 1977.
 L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D: Nonlinear Phenomena, vol. 60, no. 1–4, pp. 259–268, 1992. View at: Publisher Site  Google Scholar
 C. R. Vogel and M. E. Oman, “Iterative methods for total variation denoising,” SIAM Journal on Scientific Computing, vol. 17, no. 1, pp. 227–238, 2012. View at: Publisher Site  Google Scholar  MathSciNet
 Q. Li, L. Shen, Y. Xu, and N. Zhang, “Multistep fixedpoint proximity algorithms for solving a class of optimization problems arising from image processing,” Advances in Computational Mathematics, vol. 41, no. 2, pp. 387–422, 2015. View at: Publisher Site  Google Scholar  MathSciNet
 J. Tang, G. He, L. Dong, L. Fang, and J. Zhou, “A smoothing Newton method for the secondorder cone complementarity problem,” Applications of Mathematics, vol. 58, no. 2, pp. 223–247, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 L. Sun, G. He, Y. Wang, and C. Zhou, “An accurate active set Newton algorithm for large scale bound constrained optimization,” Applications of Mathematics, vol. 56, no. 3, pp. 297–314, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 J. Yu, M. Li, Y. Wang, and G. He, “A decomposition method for largescale box constrained optimization,” Applied Mathematics and Computation, vol. 231, no. 12, pp. 9–15, 2014. View at: Publisher Site  Google Scholar  MathSciNet
 C. Han, F. Zheng, T. Guo, and G. He, “Parallel algorithms for largescale linearly constrained minimization problem,” Acta Mathematicae Applicatae Sinica, vol. 30, no. 3, pp. 707–720, 2014. View at: Publisher Site  Google Scholar  MathSciNet
 L. Sun, L. Fang, and G. He, “An active set strategy based on the multiplier function or the gradient,” Applications of Mathematics, vol. 55, no. 4, pp. 291–304, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 T. F. Chan, G. H. Golub, and P. Mulet, “A nonlinear primaldual method for total variationbased image restoration,” SIAM Journal on Scientific Computing, vol. 20, no. 6, pp. 1964–1977, 1999. View at: Publisher Site  Google Scholar
 A. Chambolle, “An algorithm for total variation minimization and applications,” Journal of Mathematical Imaging and Vision, vol. 20, no. 12, pp. 89–97, 2004. View at: Publisher Site  Google Scholar  MathSciNet
 G. Yu, L. Qi, and Y. Dai, “On nonmonotone Chambolle gradient projection algorithms for total variation image restoration,” Journal of Mathematical Imaging and Vision, vol. 35, no. 2, pp. 143–154, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 M. Li, C. Han, R. Wang, and T. Guo, “Shrinking gradient descent algorithms for total variation regularized image denoising,” Computational Optimization and Applications, vol. 68, no. 3, pp. 643–660, 2017. View at: Publisher Site  Google Scholar  MathSciNet
 J. M. BioucasDias and M. A. T. Figueiredo, “A new TwIST: twostep iterative shrinkage/thresholding algorithms for image restoration,” IEEE Transactions on Image Processing, vol. 16, no. 12, pp. 2992–3004, 2007. View at: Publisher Site  Google Scholar  MathSciNet
 M. Elad, B. Matalon, and M. Zibulevsky, “Coordinate and subspace optimization methods for linear least squares with nonquadratic regularization,” Applied and Computational Harmonic Analysis , vol. 23, no. 3, pp. 346–367, 2007. View at: Publisher Site  Google Scholar
 B. Hao and J. Zhu, “Fast L1 regularized iterative forward backward splitting with adaptive parameter selection for image restoration,” Journal of Visual Communication and Image Representation, vol. 44, pp. 139–147, 2017. View at: Publisher Site  Google Scholar
 I. Daubechies, M. Defrise, and C. de Mol, “An iterative thresholding algorithm for linear inverse problems with a sparsity constraint,” Communications on Pure and Applied Mathematics, vol. 57, no. 11, pp. 1413–1457, 2004. View at: Publisher Site  Google Scholar  MathSciNet
 J. G. Zhu and B. B. Hao, “A new noninterior continuation method for solving a system of equalities and inequalities,” Journal of Applied Mathematics, vol. 2014, Article ID 592540, 6 pages, 2014. View at: Publisher Site  Google Scholar
 J. L. Starck, M. K. Nguyen, and F. Murtagh, “Wavelets and curvelets for image deconvolution: a combined approach,” Signal Processing, vol. 83, no. 10, pp. 2279–2283, 2003. View at: Publisher Site  Google Scholar
 Y. Wang, J. Yang, W. Yin, and Y. Zhang, “A new alternating minimization algorithm for total variation image reconstruction,” SIAM Journal on Imaging Sciences, vol. 1, no. 3, pp. 248–272, 2008. View at: Publisher Site  Google Scholar  MathSciNet
 X. Zhang, M. Burger, and X. Bresson, “Bregmanized nonlocal regularization for deconvolution and sparse reconstruction,” SIAM Journal on Imaging Sciences, vol. 3, no. 3, pp. 253–276, 2010. View at: Google Scholar  MathSciNet
 Z. Tian, M. Tian, Z. Liu, and T. Xu, “The Jacobi and GaussSeideltype iteration methods for the matrix equation AXB=C,” Applied Mathematics and Computation, vol. 292, pp. 63–75, 2017. View at: Publisher Site  Google Scholar  MathSciNet
 S. Setzer, G. Steidl, and T. Teuber, “Deblurring Poissonian images by split Bregman techniques,” Journal of Visual Communication and Image Representation, vol. 21, no. 3, pp. 193–199, 2010. View at: Publisher Site  Google Scholar
 Z. Feng, L. Fang, and G. He, “An O(nL) iteration primaldual pathfollowing method, based on wide neighbourhood and large update, for secondorder cone programming,” Optimization, vol. 63, no. 5, pp. 679–691, 2014. View at: Google Scholar
 J. Yang, Y. Zhang, and W. Yin, “A fast alternating direction method for TVL1L2 signal reconstruction from partial Fourier data,” IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 2, pp. 288–297, 2010. View at: Publisher Site  Google Scholar
 M. Tao and J. Yang, “Alternating direction algorithms for total variation deconvolution in image reconstruction,” Technical report tr0918, Department of Mathematics, Nanjing University, 2009, http://www.optimizationonline.org/DB_FILE/2009/11/2463.pdf. View at: Google Scholar
 C. Q. Miao, “Computing eigenpairs in augmented Krylov subspace produced by JacobiDavidson correction equation,” Journal of Computational and Applied Mathematics, vol. 343, pp. 363–372, 2018. View at: Publisher Site  Google Scholar  MathSciNet
 D. Gabay and B. Mercier, “A dual algorithm for the solution of nonlinear variational problems via finite element approximation,” Computers & Mathematics with Applications, vol. 2, no. 1, pp. 17–40, 1976. View at: Publisher Site  Google Scholar
 R. Y. Zhang, F. F. Xu, and J. C. Huang, “Reconstructing local volatility using total variation,” Acta Mathematica Sinica, vol. 33, no. 2, pp. 263–277, 2017. View at: Publisher Site  Google Scholar  MathSciNet
 Z. Bai, X. Dong, and C. Yin, “Existence results for impulsive nonlinear fractional differential equation with mixed boundary conditions,” Boundary Value Problems, vol. 2016, p. 63, 2016. View at: Publisher Site  Google Scholar  MathSciNet
 W. X. Ma and Y. Zhou, “Lump solutions to nonlinear partial differential equations via Hirota bilinear forms,” Journal of Differential Equations, vol. 264, no. 4, pp. 2633–2659, 2018. View at: Publisher Site  Google Scholar  MathSciNet
 Z. Wang, “A Numerical Method for Delayed FractionalOrder Differential Equations,” Journal of Applied Mathematics, vol. 2013, Article ID 256071, 7 pages, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 Z. Wang, X. Huang, and J. P. Zhou, “A numerical method for delayed fractionalorder differential equations: based on GL definition,” Applied Mathematics & Information Sciences, vol. 7, no. 2, pp. 525–529, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 C. Jiang, F. Zhang, and T. Li, “Synchronization and antisynchronization of Ncoupled fractionalorder complex systems with ring connection,” Mathematical Methods in the Applied Sciences, vol. 41, no. 7, pp. 2625–2638, 2018. View at: Publisher Site  Google Scholar  MathSciNet
 M. R. Hajiaboli, “An anisotropic fourthorder diffusion filter for image noise removal,” International Journal of Computer Vision, vol. 92, no. 2, pp. 177–191, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 Y. Zhang, M. Zhao et al., “Novel model for cascading failure based on degree strength and its application in directed genelogic networks,” Computational and Mathematical Methods in Medicine, vol. 2018, Article ID 8950794, 9 pages, 2018. View at: Publisher Site  Google Scholar
 G. Lyu, H. Yin, X. Yu, and S. Luo, “A local characteristic image restoration based on convolutional neural network,” IEICE Transaction on Information and Systems, vol. 99, no. 8, pp. 2190–2193, 2016. View at: Publisher Site  Google Scholar
 M. V. Afonso, J. M. BioucasDias, and M. A. T. Figueiredo, “Fast image recovery using variable splitting and constrained optimization,” IEEE Transactions on Image Processing, vol. 19, no. 9, pp. 2345–2356, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 S. Wang, T.Z. Huang, J. Liu, and X.G. Lv, “An alternating iterative algorithm for image deblurring and denoising problems,” Communications in Nonlinear Science and Numerical Simulation, vol. 19, no. 3, pp. 617–626, 2014. View at: Publisher Site  Google Scholar  MathSciNet
 X. G. Lv, Y. Z. Song, S. X. Wang, and J. Le, “Image restoration with a highorder total variation minimization method,” Applied Mathematical Modelling, vol. 37, no. 1617, pp. 8210–8224, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 Y. M. Huang, M. K. Ng, and Y. W. Wen, “A fast total variation minimization method for image restoration,” Multiscale Modeling & Simulation, vol. 7, no. 2, pp. 774–795, 2008. View at: Publisher Site  Google Scholar
 A. Chambolle and P.L. Lions, “Image recovery via total variation minimization and related problems,” Numerische Mathematik, vol. 76, no. 2, pp. 167–188, 1997. View at: Publisher Site  Google Scholar  MathSciNet
 T. Chan, A. Marquina, and P. Mulet, “Highorder total variationbased image restoration,” Society for Industrial and Applied Mathematics, vol. 22, no. 2, pp. 503–516, 2000. View at: Publisher Site  Google Scholar  MathSciNet
 K. Papafitsoros and C. B. Schönlieb, “A combined first and second order variational approach for image reconstruction,” Journal of Mathematical Imaging and Vision, vol. 48, no. 2, pp. 308–338, 2014. View at: Publisher Site  Google Scholar  MathSciNet
 K. Bredies, K. Kunisch, and T. Pock, “Total generalized variation,” SIAM Journal on Imaging Sciences, vol. 3, no. 3, pp. 492–526, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 S. Lefkimmiatis, A. Bourquard, and M. Unser, “Hessianbased norm regularization for image restoration with biomedical applications,” IEEE Transactions on Image Processing, vol. 21, no. 3, pp. 983–995, 2012. View at: Publisher Site  Google Scholar  MathSciNet
 G. Steidl, “A note on the dual treatment of higherorder regularization functionals,” Computing, vol. 76, no. 12, pp. 135–148, 2006. View at: Publisher Site  Google Scholar  MathSciNet
 M. Lysaker, A. Lundervold, and X. C. Tai, “Noise removal using fourthorder partial differential equation with applications to medical magnetic resonance images in space and time,” IEEE Transactions on Image Processing, vol. 12, no. 12, pp. 1579–1589, 2003. View at: Publisher Site  Google Scholar
 C. Wu and X. C. Tai, “Augmented Lagrangian method, dual methods, and split Bregman iteration for ROF, vectorial TV, and high order models,” SIAM Journal on Imaging Sciences, vol. 3, no. 3, pp. 300–339, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 A. Beck and M. Teboulle, “A fast iterative shrinkagethresholding algorithm for linear inverse problems,” SIAM Journal on Imaging Sciences, vol. 2, no. 1, pp. 183–202, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 M. Li, X. Kao, and H. Che, “Relaxed inertial accelerated algorithms for solving split equality feasibility problem,” Journal of Nonlinear Sciences and Applications, vol. 10, no. 8, pp. 4109–4121, 2017. View at: Publisher Site  Google Scholar  MathSciNet
 C. H. Liu, Y. L. Shang, and P. Han, “A new infeasibleinteriorpoint algorithm for linear programming over symmetric cones,” Acta Mathematicae Applicatae Sinica, vol. 33, no. 3, pp. 771–788, 2017. View at: Publisher Site  Google Scholar  MathSciNet
 B. Deng, T. Chen, and B. Xin, “Parallel and cyclic algorithms for quasinonexpansives in hilbert space,” Abstract and Applied Analysis, vol. 2012, Article ID 218341, 27 pages, 2012. View at: Google Scholar
 F. Zheng, C. Han, and Y. Wang, “Parallel SSLE algorithm for large scale constrained optimization,” Applied Mathematics Computation, vol. 217, no. 12, pp. 5377–5384, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 C. Han, T. Feng, G. He, and T. Guo, “Parallel variable distribution algorithm for constrained optimization with nonmonotone technique,” Journal of Applied Mathematics, vol. 2013, Article ID 295147, 7 pages, 2013. View at: Google Scholar
 L. Sun, G. He, Y. Wang, and L. Fang, “An active set quasiNewton method with projected search for bound constrained minimization,” Computers Mathematics with Applications, vol. 58, no. 1, pp. 161–170, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 Z. L. Tian, M. Tian, C. Gu, and X. Hao, “An accelerated jacobigradient based iterative algorithm for solving sylvester matrix equations,” Filomat, vol. 31, no. 8, pp. 2381–2390, 2017. View at: Publisher Site  Google Scholar
 A. Beck and M. Teboulle, “Fast gradientbased algorithms for constrained total variation image denoising and deblurring problems,” IEEE Transactions on Image Processing, vol. 18, no. 11, pp. 2419–2434, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 J. Yang, W. Yin, Y. Zhang, and Y. Wang, “A fast algorithm for edgepreserving variational multichannel image restoration,” SIAM Journal on Imaging Sciences, vol. 2, no. 2, pp. 569–592, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 M. K. Ng, R. H. Chan, and W.C. Tang, “A fast algorithm for deblurring models with Neumann boundary conditions,” SIAM Journal on Scientific Computing, vol. 21, no. 3, pp. 851–866, 1999. View at: Publisher Site  Google Scholar
 R. C. Gonzalez and R. E. Woods, Digital Image Processing, AddisonWesley, Reading, MA, USA, 3rd edition, 2007.
 Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2018 Jianguang Zhu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.