Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2017, Article ID 3012910, 13 pages
https://doi.org/10.1155/2017/3012910
Research Article

A Coordinate Descent Method for Total Variation Minimization

1Northeast Agricultural University, Harbin 150001, China
2Harbin Institute of Technology, Research Group for Computational Photography and Statistical Learning, School of Computer Science and Technology, Harbin 150001, China
3No. 211 Hospital of PLA, Harbin 150001, China
4Department of Computing, The Hong Kong Polytechnic University, Kowloon, Hong Kong

Correspondence should be addressed to Wangmeng Zuo; moc.liamg@ouzmwsc

Received 5 May 2017; Accepted 10 August 2017; Published 18 September 2017

Academic Editor: Gerardo Severino

Copyright © 2017 Hong Deng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D. Nonlinear Phenomena, vol. 60, no. 1-4, pp. 259–268, 1992. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  2. J. Wen, J. Zhao, W. Cailing, S. Yan, and W. Wang, “Blind deblurring from single motion image based on adaptive weighted total variation algorithm,” IET Signal Processing, vol. 10, no. 6, pp. 611–618, 2016. View at Publisher · View at Google Scholar · View at Scopus
  3. D. Perrone and P. Favaro, “A Clearer Picture of Total Variation Blind Deconvolution,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 6, pp. 1041–1055, 2016. View at Publisher · View at Google Scholar · View at Scopus
  4. K. Dillon, Y. Fainman, and Y.-P. Wang, “Computational estimation of resolution in reconstruction techniques utilizing sparsity, total variation, and nonnegativity,” Journal of Electronic Imaging, vol. 25, no. 5, Article ID 053016, 2016. View at Publisher · View at Google Scholar · View at Scopus
  5. M. K. Ng, H. Shen, E. Y. Lam, and L. Zhang, “A total variation regularization based super-resolution reconstruction algorithm for digital video,” Eurasip Journal on Advances in Signal Processing, vol. 2007, Article ID 74585, 2007. View at Publisher · View at Google Scholar · View at Scopus
  6. Q. Cheng, H. Shen, L. Zhang, and P. Li, “Inpainting for remotely sensed images with a multichannel nonlocal total variation model,” IEEE Transactions on Geoscience and Remote Sensing, vol. 52, no. 1, pp. 175–187, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. T. F. Chan, J. Shen, and H.-M. Zhou, “Total variation wavelet inpainting,” Journal of Mathematical Imaging and Vision, vol. 25, no. 1, pp. 107–125, 2006. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  8. V. M. Patel, R. Maleh, A. C. Gilbert, and R. Chellappa, “Gradient-based image recovery methods from incomplete Fourier measurements,” IEEE Transactions on Image Processing, vol. 21, no. 1, pp. 94–105, 2012. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  9. J. Yang, Y. Zhang, and W. Yin, “A fast alternating direction method for TVL1-L2 signal reconstruction from partial Fourier data,” IEEE Journal on Selected Topics in Signal Processing, vol. 4, no. 2, pp. 288–297, 2010. View at Publisher · View at Google Scholar · View at Scopus
  10. M. Elad, B. Matalon, and M. Zibulevsky, “Image denoising with shrinkage and redundant representations,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1924–1931, June 2006. View at Publisher · View at Google Scholar · View at Scopus
  11. M. Aharon, M. Elad, and A. Bruckstein, “K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation,” IEEE Transactions on Signal Processing, vol. 54, no. 11, pp. 4311–4322, 2006. View at Publisher · View at Google Scholar · View at Scopus
  12. J. Mairal, F. Bach, and J. Ponce, “Task-driven dictionary learning,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 4, pp. 791–804, 2012. View at Publisher · View at Google Scholar · View at Scopus
  13. J. Xu, L. Zhang, W. Zuo, D. Zhang, and X. Feng, “Patch group based nonlocal self-similarity prior learning for image denoising,” in Proceedings of the 15th IEEE International Conference on Computer Vision, ICCV 2015, pp. 244–252, December 2015. View at Publisher · View at Google Scholar · View at Scopus
  14. W. Yang, J. Liu, S. Yang, and Z. Quo, “Image super-resolution via nonlocal similarity and group structured sparse representation,” in Proceedings of the Visual Communications and Image Processing, VCIP 2015, December 2015. View at Publisher · View at Google Scholar · View at Scopus
  15. R. Xiong, H. Liu, X. Zhang et al., “Image denoising via bandwise adaptive modeling and regularization exploiting nonlocal similarity,” IEEE Transactions on Image Processing, vol. 25, no. 12, pp. 5793–5805, 2016. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  16. S. Wang, L. Jiao, and S. Yang, “SAR Images Change Detection Based on Spatial Coding and Nonlocal Similarity Pooling,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 9, no. 8, pp. 3452–3466, 2016. View at Publisher · View at Google Scholar · View at Scopus
  17. H. Liu, R. Xiong, S. Ma, X. Fan, and W. Gao, “Non-local extension of total variation regularization for image restoration,” in Proceedings of the 2014 IEEE International Symposium on Circuits and Systems, ISCAS 2014, pp. 1102–1105, June 2014. View at Publisher · View at Google Scholar · View at Scopus
  18. D. Perrone and P. Favaro, “Total variation blind deconvolution: the devil is in the details,” in Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '14), pp. 2909–2916, IEEE, June 2014. View at Publisher · View at Google Scholar · View at Scopus
  19. D. Needell and R. Ward, “Stable image reconstruction using total variation minimization,” SIAM Journal on Imaging Sciences, vol. 6, no. 2, pp. 1035–1058, 2013. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  20. R. I. Boţ and C. Hendrich, “Convergence analysis for a primal-dual monotone + skew splitting algorithm with applications to total variation minimization,” Journal of Mathematical Imaging and Vision, vol. 49, no. 3, pp. 551–568, 2014. View at Publisher · View at Google Scholar · View at MathSciNet
  21. L. Ambrosio and S. Di Marino, “Equivalent definitions of BV space and of total variation on metric measure spaces,” Journal of Functional Analysis, vol. 266, no. 7, pp. 4150–4188, 2014. View at Publisher · View at Google Scholar · View at MathSciNet
  22. H. Wu, Y. Wu, and Z. Wen, “Texture Smoothing Based on Adaptive Total Variation,” Advances in Intelligent Systems and Computing, vol. 277, pp. 43–54, 2014. View at Publisher · View at Google Scholar · View at Scopus
  23. R. W. Liu, L. Shi, W. Huang, J. Xu, S. C. H. Yu, and D. Wang, “Generalized total variation-based MRI Rician denoising model with spatially adaptive regularization parameters,” Magnetic Resonance Imaging, vol. 32, no. 6, pp. 702–720, 2014. View at Publisher · View at Google Scholar
  24. J. Xu, D. Ren, L. Zhang, and D. Zhang, “Patch Group Based Bayesian Learning for Blind Image Denoising,” in Computer Vision – ACCV 2016 Workshops, vol. 10116 of Lecture Notes in Computer Science, pp. 79–95, Springer International Publishing, Berlin, Germany, 2017. View at Publisher · View at Google Scholar
  25. J.-L. Starck, M. Elad, and D. L. Donoho, “Image decomposition via the combination of sparse representations and a variational approach,” IEEE Transactions on Image Processing, vol. 14, no. 10, pp. 1570–1582, 2005. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  26. T. Zeng, Study on the variational models and dictionary learning [Ph.D. thesis], Université Paris-Nord-Paris XIII, France, 2007.
  27. S. Ono and I. Yamada, “Decorrelated vectorial total variation,” in Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 4090–4097, June 2014. View at Publisher · View at Google Scholar · View at Scopus
  28. J.-F. Aujol and S. H. Kang, “Color image decomposition and restoration,” Journal of Visual Communication and Image Representation, vol. 17, no. 4, pp. 916–928, 2006. View at Publisher · View at Google Scholar · View at Scopus
  29. K. Bredies, K. Kunisch, and T. Pock, “Total generalized variation,” SIAM Journal on Imaging Sciences, vol. 3, no. 3, pp. 492–526, 2010. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  30. L. Xu, Q. Yan, Y. Xia, and J. Jia, “Structure extraction from texture via relative total variation,” ACM Transactions on Graphics, vol. 31, no. 6, article 139, 2012. View at Publisher · View at Google Scholar · View at Scopus
  31. H. Xu, Q. Sun, N. Luo, G. Cao, and D. Xia, “Iterative nonlocal totalvariation regularization method for image restoration,” PLoS ONE, vol. 8, no. 6, Article ID e65865, 2013. View at Publisher · View at Google Scholar · View at Scopus
  32. L. Antonelli, V. De Simone, and D. di Serafino, “On the application of the spectral projected gradient method in image segmentation,” Journal of Mathematical Imaging and Vision, vol. 54, no. 1, pp. 106–116, 2016. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  33. R. De Asmundis, D. di Serafino, and G. Landi, “On the regularizing behavior of the SDA and SDC gradient methods in the solution of linear ill-posed problems,” Journal of Computational and Applied Mathematics, vol. 302, pp. 81–93, 2016. View at Publisher · View at Google Scholar · View at MathSciNet
  34. S. Bonettini, R. Zanella, and L. Zanni, “A scaled gradient projection method for constrained image deblurring,” Inverse Problems, vol. 25, no. 1, Article ID 015002, 015002, 23 pages, 2009. View at Publisher · View at Google Scholar · View at MathSciNet
  35. R. Fletcher, “A limited memory steepest descent method,” Mathematical Programming, vol. 135, no. 1-2, Ser. A, pp. 413–436, 2012. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  36. C. C. Gonzaga and R. M. Schneider, “On the steepest descent algorithm for quadratic functions,” Computational Optimization and Applications. An International Journal, vol. 63, no. 2, pp. 523–542, 2016. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  37. R. De Asmundis, D. di Serafino, W. W. Hager, G. Toraldo, and H. Zhang, “An efficient gradient method using the Yuan steplength,” Computational Optimization and Applications. An International Journal, vol. 59, no. 3, pp. 541–563, 2014. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  38. Y. Li and F. Santosa, “A computational algorithm for minimizing total variation in image restoration,” IEEE Transactions on Image Processing, vol. 5, no. 6, pp. 987–995, 1996. View at Publisher · View at Google Scholar · View at Scopus
  39. T. F. Chan, H. M. Zhou, and R. H. Chan, “Continuation method for total variation denoising problems,” in Proceedings of the Advanced Signal Processing Algorithms, pp. 314–325, San Diego, CA, USA, 1995. View at Publisher · View at Google Scholar · View at Scopus
  40. C. R. Vogel and M. E. Oman, “Fast, robust total variation-based reconstruction of noisy, blurred images,” IEEE Transactions on Image Processing, vol. 7, no. 6, pp. 813–824, 1998. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  41. C. R. Vogel and M. E. Oman, “Iterative methods for total variation denoising,” SIAM Journal on Scientific Computing, vol. 17, no. 1, pp. 227–238, 1996. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  42. D. Yi, “An iterative scheme for total variation-based image denoising,” Journal of Scientific Computing, vol. 58, no. 3, pp. 648–671, 2014. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  43. A. Chambolle, “An algorithm for total variation minimization and applications,” Journal of Mathematical Imaging and Vision, vol. 20, no. 1-2, pp. 89–97, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  44. D. Yi, B. Choi, and E.-Y. Kim, “An effective method for solving nonlinear equations and its application,” Applied Mathematics and Computation, vol. 220, pp. 568–579, 2013. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  45. T. F. Chan, K. Chen, and J. L. Carter, “Iterative methods for solving the dual formulation arising from image restoration,” Electronic Transactions on Numerical Analysis, vol. 26, pp. 299–311, 2007. View at Google Scholar · View at MathSciNet · View at Scopus
  46. A. Chambolle and T. Pock, “A first-order primal-dual algorithm for convex problems with applications to imaging,” Journal of Mathematical Imaging and Vision, vol. 40, no. 1, pp. 120–145, 2011. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  47. T. F. Chan, G. H. Golub, and P. Mulet, “A nonlinear primal-dual method for total variation-based image restoration,” SIAM Journal on Scientific Computing, vol. 20, no. 6, pp. 1964–1977, 1999. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  48. M. Zhu and T. Chan, “An efficient primal-dual hybrid gradient algorithm for total variation image restoration,” UCLA CAM Report, pp. 8–34, 2008. View at Google Scholar
  49. J. M. Bioucas-Dias and M. A. Figueiredo, “A new TwIST: two-step iterative shrinkage/thresholding algorithms for image restoration,” IEEE Transactions on Image Processing, vol. 16, no. 12, pp. 2992–3004, 2007. View at Publisher · View at Google Scholar · View at MathSciNet
  50. A. Beck and M. Teboulle, “Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems,” IEEE Transactions on Image Processing, vol. 18, no. 11, pp. 2419–2434, 2009. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  51. M. V. Afonso, J. M. Bioucas-Dias, and M. A. Figueiredo, “Fast image recovery using variable splitting and constrained optimization,” IEEE Transactions on Image Processing, vol. 19, no. 9, pp. 2345–2356, 2010. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  52. J. Darbon and M. Sigelle, “A Fast and Exact Algorithm for Total Variation Minimization,” in Pattern Recognition and Image Analysis, vol. 3522 of Lecture Notes in Computer Science, pp. 351–359, Springer Berlin Heidelberg, Berlin, Heidelberg, 2005. View at Publisher · View at Google Scholar
  53. A. Chambolle, “Total variation minimization and a class of binary MRF models,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3757, pp. 136–152, 2005. View at Publisher · View at Google Scholar · View at Scopus
  54. D. Goldfarb and W. Yin, “Parametric maximum flow algorithms for fast total variation minimization,” SIAM Journal on Scientific Computing, vol. 31, no. 5, pp. 3712–3743, 2009. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  55. Y. Li and S. Osher, “A new median formula with applications to PDE based denoising,” Communications in Mathematical Sciences, vol. 7, no. 3, pp. 741–753, 2009. View at Publisher · View at Google Scholar · View at MathSciNet
  56. J. Friedman, T. Hastie, H. Höfling, and R. Tibshirani, “Pathwise coordinate optimization,” The Annals of Applied Statistics, vol. 1, no. 2, pp. 302–332, 2007. View at Publisher · View at Google Scholar · View at MathSciNet
  57. T. F. Chan and K. Chen, “An optimization-based multilevel algorithm for total variation image denoising,” Multiscale Modeling and Simulation, vol. 5, no. 2, pp. 615–645, 2006. View at Publisher · View at Google Scholar · View at Scopus
  58. Q. Zhang, L. Xu, and J. Jia, “100+ times faster weighted median filter (WMF),” in Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 2830–2837, June 2014. View at Publisher · View at Google Scholar · View at Scopus
  59. S. Perreault and P. Hébert, “Median filtering in constant time,” IEEE Transactions on Image Processing, vol. 16, no. 9, pp. 2389–2394, 2007. View at Publisher · View at Google Scholar · View at MathSciNet
  60. W. Zuo and Z. Lin, “A generalized accelerated proximal gradient approach for total-variation-based image restoration,” IEEE Transactions on Image Processing, vol. 20, no. 10, pp. 2748–2759, 2011. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  61. O. V. Michailovich, “An iterative shrinkage approach to total-variation image restoration,” IEEE Transactions on Image Processing, vol. 20, no. 5, pp. 1281–1299, 2011. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  62. Y. Li and S. Osher, “Coordinate descent optimization for l1 minimization with application to compressed sensing; a greedy algorithm,” Inverse Problems and Imaging, vol. 3, no. 3, pp. 487–503, 2009. View at Publisher · View at Google Scholar
  63. Y. Nesterov, “Efficiency of coordinate descent methods on huge-scale optimization problems,” SIAM Journal on Optimization, vol. 22, no. 2, pp. 341–362, 2012. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus