Copyright © 2008 The Institute of Electronics, Information and Communication Engineers
Regular Section -- Papers -- Image Processing and Video Processing |
Video Error Concealment Using Fidelity Tracking
1 The authors are with KDDI R&D Laboratories Inc., Fujimino-shi, 356–8502 Japan. E-mail: yoneyama{at}kddilabs.jp, 2 The author is with Tokyo Institute of Technology, Yokohama-shi, 226–8503 Japan.
We propose a method to prevent the degradation of decoded MPEG pictures caused by video transmission over error-prone networks. In this paper, we focus on the error concealment that is processed at the decoder without using any backchannels. Though there have been various approaches to this problem, they generally focus on minimizing the degradation measured frame by frame. Although this frame-level approach is effective in evaluating individual frame quality, in the sense of human perception, the most noticeable feature is the spatio-temporal discontinuity of the image feature in the decoded video image. We propose a novel error concealment algorithm comprising the combination of i) A spatio-temporal error recovery function with low processing cost, ii) A MB-based image fidelity tracking scheme, and iii) An adaptive post-filter using the fidelity information. It is demonstrated by experimental results that the proposed algorithm can significantly reduce the subjective degradation of corrupted MPEG video quality with about 30 % of additional decoding processing power.
Key Words: error concealment, MPEG, H.264/AVC, error resilience
Manuscript received October 20, 2006. Manuscript revised April 23, 2007.
Reference
[1] T. Stockhammer, M.M. Hannuksela, and T. Wiegand, "H.264/AVC in wireless environments," IEEE Trans. Circuits Syst. Video Technol., vol.13, no.7, pp.657–673, 2003. [2] S. Lin, D.J. Costello, and M.J. Miller, "Automatic repeat error control schemes," IEEE Trans. Commun. Mag., vol.22, no.12, pp.5–17, 1984. [3] Y.C. Lee, Y. Altunbasak, and R.M. Mersereau, "Multiframe error concealment for MPEG-coded video delivery over error-prone networks," IEEE Trans. Image Process., vol.11, no.11, pp.1314–1331, 2002. [4] X. Li and M.T. Orchard, "Novel sequential error-concealment techniques using orientation adaptive interpolation," IEEE Trans. Circuits Syst. Video Technol., vol.12, no.10, pp.857–864, 2002. [5] S. Tsekeridou and I. Pitas, "MPEG-2 error concealment based on block-matching principles," IEEE Trans. Circuits Syst. Video Technol., vol.10, no.4, pp.646–658, 2000. [6] J.W. Park, J.W. Kim, and S.U. Lee, "DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error," IEEE Trans. Circuits Syst. Video Technol., vol.7, no.6, pp.845–854, 1997. [7] Y.-L. Tung, H.-C. Shu, and J.-J. Leou, "An error detection and concealment scheme for H.264 video transmission," IEEE Proc. ICME, pp.1735–1738, 2004. [8] S. Belfiore, M. Grangetto, E. Magli, and G. Olmo, "An error concealment algorithm for streaming video," IEEE Proc. ICIP, pp.649–652, 2003. [9] J. Zhang, J.F. Arnold, and M.R. Frater, "A cell-loss concealment technique for MPEG-2 coded video," IEEE Trans. Circuits Syst. Video Technol., vol.10, no.4, pp.659–665, 2000. [10] S. Valente, C. Dufour, and D. Snook, "An efficient error concealment implementation for MPEG-4 video streams," IEEE Trans. Consum. Electron., vol.47, no.3, pp.568–578, 2001. [11] J. Park, D.-C. Park, R.J. Marks, II, and M.A. El-Sharkawi, "Content-based adaptive spatio-temporal methods for MPEG repair," IEEE Trans. Image Process., vol.13, no.8, pp.1066–1077, Aug. 2004. [12] A. Yoneyama, H. Yanagihara, Y. Takishima, and Y. Nakajima, "Video error concealment by the combination of spatio-temporal recovery and post-filter for H.264," IEEE Proc. ICCE, pp.361–362, 2005. [13] S.-C. Pei and Y.-Z. Chou, "Novel error concealment method with adaptive prediction to the abrupt and gradual scene changes," IEEE Trans. Multimed., vol.6, no.1, pp.158–173, 2004. [14] W.-Y. Kung, C.-S. Kim, and C.-C. Jay Kuo, "Spatial and temporal error concealment techniques for video transmission over noisy channels," IEEE Trans. Circuits Syst. Video Technol., vol.16, no.7, pp.789–803, 2006. [15] Y.-K. Wang, M.M. Hannuksela, V. Varsa, and A. Hourunranta, and M. Gabbouj, "The error concealment feature in the H.26L test model," Proc. IEEE ICIP, vol.II, pp.729–732, 2002. [16] V. Varsa, M.M. Hannuksela, and Y.-K. Wang, "Non-normative error concealment algorithms," VCEG-N62, Sept. 2001. [17] L. Su, Y. Zhang, W. Gao, Q. Huang, and Y. Lu, "Improved error concealment algorithm based on H.264/AVC non-normative decoder," IEEE Proc. ICME, pp.1671–1674, 2004. [18] VQEG: http://www.vqeg.org/
CiteULike 
Connotea 
Del.icio.us What's this?
This Article 
Abstract
Full Text (PDF)
Alert me when this article is cited
Alert me if a correction is posted
Services
Email this article to a friend
Similar articles in this journal
Alert me to new issues of the journal
Add to My Personal Archive
Download to citation manager
Request Permissions
Google Scholar
Articles by YONEYAMA, A.
Articles by HATORI, Y.
Search for Related Content
Social Bookmarking
What's this?