Table of Contents Author Guidelines Submit a Manuscript
Abstract and Applied Analysis
Volume 2014 (2014), Article ID 618641, 6 pages
http://dx.doi.org/10.1155/2014/618641
Research Article

Asynchronous Gossip-Based Gradient-Free Method for Multiagent Optimization

College of Automation, Nanjing University of Posts and Telecommunications, Nanjing 210046, China

Received 12 January 2014; Accepted 11 March 2014; Published 2 April 2014

Academic Editor: Hao Shen

Copyright © 2014 Deming Yuan. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. C. Duchi, A. Agarwal, and M. J. Wainwright, “Dual averaging for distributed optimization: convergence analysis and network scaling,” IEEE Transactions on Automatic Control, vol. 57, no. 3, pp. 592–606, 2012. View at Publisher · View at Google Scholar · View at MathSciNet
  2. B. Johansson, T. Keviczky, M. Johansson, and K. H. Johansson, “Subgradient methods and consensus algorithms for solving convex optimization problems,” in Proceedings of the 47th IEEE Conference on Decision and Control (CDC '08), pp. 4185–4190, Cancun, Mexico, December 2008. View at Publisher · View at Google Scholar · View at Scopus
  3. A. Nedić and A. Ozdaglar, “Distributed subgradient methods for multi-agent optimization,” IEEE Transactions on Automatic Control, vol. 54, no. 1, pp. 48–61, 2009. View at Publisher · View at Google Scholar · View at MathSciNet
  4. A. Nedić, A. Ozdaglar, and P. A. Parrilo, “Constrained consensus and optimization in multi-agent networks,” IEEE Transactions on Automatic Control, vol. 55, no. 4, pp. 922–938, 2010. View at Publisher · View at Google Scholar · View at MathSciNet
  5. A. Nedić, “Asynchronous broadcast-based convex optimization over a network,” IEEE Transactions on Automatic Control, vol. 56, no. 6, pp. 1337–1351, 2011. View at Publisher · View at Google Scholar · View at MathSciNet
  6. D. Yuan, S. Xu, and H. Zhao, “Distributed primal-dual subgradient method for multiagent optimization via consensus algorithms,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 41, no. 6, pp. 1715–1724, 2011. View at Publisher · View at Google Scholar · View at Scopus
  7. M. Zhu and S. Martínez, “On distributed convex optimization under inequality and equality constraints,” IEEE Transactions on Automatic Control, vol. 57, no. 1, pp. 151–164, 2012. View at Publisher · View at Google Scholar · View at MathSciNet
  8. S. S. Ram, A. Nedić, and V. V. Veeravalli, “Distributed stochastic subgradient projection algorithms for convex optimization,” Journal of Optimization Theory and Applications, vol. 147, no. 3, pp. 516–545, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  9. M. G. Rabbat and R. D. Nowak, “Distributed optimization in sensor networks,” in Proceedings of the 3rd International Symposium on Information Processing in Sensor Networks, pp. 20–27, Berkeley, Calif, USA, 2004. View at Publisher · View at Google Scholar
  10. J. Lu, C. Y. Tang, P. R. Regier, and T. D. Bow, “Gossip algorithms for convex consensus optimization over networks,” IEEE Transactions on Automatic Control, vol. 56, no. 12, pp. 2917–2923, 2011. View at Publisher · View at Google Scholar · View at MathSciNet
  11. D. Yuan, S. Xu, H. Zhao, and L. Rong, “Distributed dual averaging method for multi-agent optimization with quantized communication,” Systems & Control Letters, vol. 61, no. 11, pp. 1053–1061, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  12. D. Yuan, S. Xu, B. Zhang, and L. Rong, “Distributed primal-dual stochastic subgradient algorithms for multi-agent optimization under inequality constraints,” International Journal of Robust and Nonlinear Control, vol. 23, no. 16, pp. 1846–1868, 2013. View at Google Scholar · View at MathSciNet
  13. D. Yuan, S. Xu, and J. Lu, “Gradient-free method for distributed multi-agent optimization via push-sum algorithms,” International Journal of Robust and Nonlinear Control. In press. View at Publisher · View at Google Scholar
  14. S. S. Ram, A. Nedić, and V. V. Veeravalli, “Asynchronous gossip algorithms for stochastic optimization,” in Proceedings of the 48th IEEE Conference on Decision and Control Held Jointly with the 28th Chinese Control Conference (CDC/CCC '09), pp. 3581–3586, Shanghai, China, December 2009. View at Publisher · View at Google Scholar · View at Scopus
  15. K. Srivastava and A. Nedić, “Distributed asynchronous constrained stochastic optimization,” IEEE Journal on Selected Topics in Signal Processing, vol. 5, no. 4, pp. 772–790, 2011. View at Publisher · View at Google Scholar · View at Scopus
  16. S. Lee and A. Nedic, “Distributed random projection algorithm for convex optimization,” IEEE Journal of Selected Topics in Signal Processing, vol. 7, no. 2, pp. 221–229, 2013. View at Publisher · View at Google Scholar
  17. S. Lee and A. Nedich, “Asynchronous gossip-based random projection algorithms over networks,” submitted to IEEE Transactions on Automatic Control.
  18. S. S. Ram, A. Nedic, and V. V. Veeravalli, “Asynchronous gossip algorithms for stochastic optimization: constant stepsize analysis,” in Recent Advances in Optimization and Its Applications in Engineering, M. Diehl, F. Glineur F, E. Jarlebring, and W. Michiels, Eds., pp. 51–60, Springer, Berlin, Germany, 2010. View at Google Scholar
  19. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, “Randomized gossip algorithms,” IEEE Transactions on Information Theory, vol. 52, no. 6, pp. 2508–2530, 2006. View at Publisher · View at Google Scholar · View at MathSciNet
  20. Yu. Nesterov, “Random gradient-free minimization of convex functions,” CORE Discussion Paper 2011/1, 2011.
  21. A. R. Conn, K. Scheinberg, and L. N. Vicente, Introduction to Derivative-Free Optimization, vol. 8 of MPS/SIAM Series on Optimization, SIAM, Philadelphia, Pa, USA, 2009. View at Publisher · View at Google Scholar · View at MathSciNet
  22. W. Ren and R. W. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,” IEEE Transactions on Automatic Control, vol. 50, no. 5, pp. 655–661, 2005. View at Publisher · View at Google Scholar · View at MathSciNet
  23. R. Olfati-Saber and R. M. Murray, “Consensus problems in networks of agents with switching topology and time-delays,” IEEE Transactions on Automatic Control, vol. 49, no. 9, pp. 1520–1533, 2004. View at Publisher · View at Google Scholar · View at MathSciNet
  24. L. Xiao and S. Boyd, “Fast linear iterations for distributed averaging,” Systems & Control Letters, vol. 53, no. 1, pp. 65–78, 2004. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  25. D. Yuan, S. Xu, H. Zhao, and Y. Chu, “Distributed average consensus via gossip algorithm with real-valued and quantized data for 0<q<1,” Systems & Control Letters, vol. 59, no. 9, pp. 536–542, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  26. J. Lu, D. W. C. Ho, and J. Kurths, “Consensus over directed static networks with arbitrary finite communication delays,” Physical Review E, vol. 80, no. 6, Article ID 066121, 2009. View at Publisher · View at Google Scholar · View at Scopus