Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2016, Article ID 3934872, 11 pages
http://dx.doi.org/10.1155/2016/3934872
Research Article

A General Solution to Least Squares Problems with Box Constraints and Its Applications

Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang 110004, China

Received 15 November 2015; Revised 4 March 2016; Accepted 18 April 2016

Academic Editor: Masoud Hajarian

Copyright © 2016 Yueyang Teng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. D. D. Lee and H. S. Seung, “Algorithms for non-negative matrix factorization,” in Proceedings of the Advances in Neural Information Processing Systems 13 (NIPS '00), pp. 556–562, Breckenridge, Colo, USA, 2000.
  2. Y. Lin and D. D. Lee, “Bayesian regularization and nonnegative deconvolution for room impulse response estimation,” IEEE Transactions on Signal Processing, vol. 54, no. 3, pp. 839–847, 2006. View at Publisher · View at Google Scholar · View at Scopus
  3. O. L. Mangasarian and D. R. Musicant, “Lagrangian support vector machines,” Journal of Machine Learning Research, vol. 1, no. 3, pp. 161–177, 2001. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  4. A. R. De Pierro, “On the relation between the ISRA and the EM algorithm for positron emission tomography,” IEEE Transactions on Medical Imaging, vol. 12, no. 2, pp. 328–333, 1993. View at Publisher · View at Google Scholar · View at Scopus
  5. J. A. Fessler, “Penalized weighted least-squares image reconstruction for positron emission tomography,” IEEE Transactions on Medical Imaging, vol. 13, no. 2, pp. 290–300, 1994. View at Publisher · View at Google Scholar · View at Scopus
  6. M. Piana and M. Bertero, “Projected Landweber method and preconditioning,” Inverse Problems, vol. 13, no. 2, pp. 441–463, 1997. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  7. H. Lantéri, M. Roche, O. Cuevas, and C. Aime, “A general method to devise maximum-likelihood signal restoration multiplicative algorithms with non-negativity constraints,” Signal Processing, vol. 81, no. 5, pp. 945–974, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  8. H. Lanteri, M. Roche, and C. Aime, “Penalized maximum likelihood image restoration with positivity constraints: multiplicative algorithms,” Inverse Problems, vol. 18, no. 5, pp. 1397–1419, 2002. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  9. K. Lange, D. R. Hunter, and I. Yang, “Optimization transfer using surrogate objective functions,” Journal of Computational and Graphical Statistics, vol. 9, no. 1, pp. 1–20, 2000. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  10. L. A. Shepp and Y. Vardi, “Maximum likelihood reconstruction for emission tomography,” IEEE Transactions on Medical Imaging, vol. 1, no. 2, pp. 113–122, 1982. View at Publisher · View at Google Scholar · View at Scopus
  11. A. Cichocki, H. Lee, Y.-D. Kim, and S. Choi, “Non-negative matrix factorization with α-divergence,” Pattern Recognition Letters, vol. 29, no. 9, pp. 1433–1440, 2008. View at Publisher · View at Google Scholar · View at Scopus
  12. W. I. Zangwill, Nonlinear Programming: A Unified Approach, Prentice-Hall, New York, NY, USA, 1969. View at MathSciNet
  13. A. R. De Pierro, “A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography,” IEEE Transactions on Medical Imaging, vol. 14, no. 1, pp. 132–137, 1995. View at Publisher · View at Google Scholar · View at Scopus
  14. A. R. De Pierro, “On the convergence of an EM-type algorithm for penlaized likelihood estimation in emission tomography,” IEEE Transactions on Medical Imaging, vol. 14, pp. 762–765, 1995. View at Google Scholar
  15. C. F. J. Wu, “On the convergence properties of the EM algorithm,” The Annals of Statistics, vol. 11, no. 1, pp. 95–103, 1983. View at Publisher · View at Google Scholar · View at MathSciNet
  16. K. Lange and R. Carson, “EM reconstruction algorithms for emission and transmission tomography,” Journal of Computer Assisted Tomography, vol. 8, no. 2, pp. 306–316, 1984. View at Google Scholar · View at Scopus
  17. Y. Teng, Y. Zhang, H. Li, and Y. Kang, “A convergent non-negative deconvolution algorithm with Tikhonov regularization,” Inverse Problems, vol. 31, no. 3, Article ID 035002, 2015. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  18. A. M. Ostrowski, Solution of Equations in Euclidean and Banach Spaces, Academic Press, New York, NY, USA, 1973. View at MathSciNet
  19. B. Scholkopf, C. Burges, and A. Smola, “Making large-scale SVM learning practical,” in Advances in Kernel Methods, pp. 169–184, MIT Press, Cambridge, Mass, USA, 1998. View at Google Scholar
  20. J. C. Platt, “Fast training of support vector machines using sequential minimal optimization,” in Advances in Kernel Methods Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds., pp. 185–208, MIT Press, Cambridge, Mass, USA, 1999. View at Google Scholar
  21. C.-J. Hsieh, K.-W. Chang, C.-J. Lin, S. S. Keerthi, and S. Sundararajan, “A dual coordinate descent method for large-scale linear SVM,” in Proceedings of the 25th International Conference on Machine Learning (ICML '08), pp. 408–415, Helsinki, Finland, July 2008. View at Scopus
  22. H. Andrews and B. Hunt, Digital Image Restoration, Prentice-Hall, Englewood Cliffs, NJ, USA, 1977.
  23. M. Bertero and P. Boccacci, Introduction to Inverse Problems in Imaging, IOP Publishing, London, UK, 1998. View at Publisher · View at Google Scholar · View at MathSciNet
  24. S. Walrand, F. Jamar, and S. Pauwels, “Improved solution for ill-posed linear systems using a constrained optimization ruled by a penalty: evaluation in nuclear medicine tomography,” Inverse Problems, vol. 25, no. 11, Article ID 115004, 2009. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  25. A. Beck and M. Teboulle, “A fast iterative shrinkage-thresholding algorithm for linear inverse problems,” SIAM Journal on Imaging Sciences, vol. 2, no. 1, pp. 183–202, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  26. H. Liu, L. Yan, Y. Chang, H. Fang, and T. Zhang, “Spectral deconvolution and feature extraction with robust adaptive Tikhonov regularization,” IEEE Transactions on Instrumentation and Measurement, vol. 62, no. 2, pp. 315–327, 2013. View at Publisher · View at Google Scholar · View at Scopus
  27. A. N. Tikhonov, A. V. Goncharsky, V. V. Stepanov, and A. G. Yagola, Numerical Methods for the Solution of Ill-Posed Problems, Kluwer Academic Publishers, Boston, Mass, USA, 1995. View at Publisher · View at Google Scholar · View at MathSciNet
  28. A. N. Tikhonov and V. Y. Arsenin, Solution of Ill-Posed Problems, Winston & Sons, Washington, DC, USA, 1977.
  29. S. Boyd, N. Parikh, E. Chu, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends in Machine Learning, vol. 3, no. 1, pp. 1–122, 2011. View at Google Scholar
  30. J. F. C. Mota, J. M. F. Xavier, P. M. Q. Aguiar, and M. Püschel, “D-ADMM: a communication-efficient distributed algorithm for separable optimization,” IEEE Transactions on Signal Processing, vol. 61, no. 10, pp. 2718–2723, 2013. View at Publisher · View at Google Scholar · View at MathSciNet
  31. G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopins University Press, Baltimore, Md, USA, 1996. View at MathSciNet
  32. http://web.stanford.edu/group/SOL/index.html.