EURASIP Journal on Applied Signal Processing
Volume 2006 (2006), Article ID 32592, 12 pages
doi:10.1155/ASP/2006/32592

End-to-End Rate-Distortion Optimized MD Mode Selection for Multiple Description Video Coding

Brian A. Heng,1 John G. Apostolopoulos,2 and Jae S. Lim1

1Massachusetts Institute of Technology, Cambridge 02139, MA, USA
2Streaming Media Systems Group, Hewlett-Packard Labs, Palo Alto 94304, CA, USA

Received 10 March 2005; Revised 13 August 2005; Accepted 1 September 2005

Copyright © 2006 Brian A. Heng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Multiple description (MD) video coding can be used to reduce the detrimental effects caused by transmission over lossy packet networks. A number of approaches have been proposed for MD coding, where each provides a different tradeoff between compression efficiency and error resilience. How effectively each method achieves this tradeoff depends on the network conditions as well as on the characteristics of the video itself. This paper proposes an adaptive MD coding approach which adapts to these conditions through the use of adaptive MD mode selection. The encoder in this system is able to accurately estimate the expected end-to-end distortion, accounting for both compression and packet loss-induced distortions, as well as for the bursty nature of channel losses and the effective use of multiple transmission paths. With this model of the expected end-to-end distortion, the encoder selects between MD coding modes in a rate-distortion (R-D) optimized manner to most effectively tradeoff compression efficiency for error resilience. We show how this approach adapts to both the local characteristics of the video and network conditions and demonstrates the resulting gains in performance using an H.264-based adaptive MD video coder.