In this thesis, we propose a novel error concealment technique to deal with the case of entire-frame loss. We also propose an error resilience technique based on MV correction. We conclude our accomplishment as below:
1. We propose a novel MV correction algorithm based on the fuzzy reliability that depends on the spatial and temporal consistency. This algorithm makes the corrected MV more close to the actual motion trajectory and may increase the performance of error concealment based on motion projection.
2. We propose a novel error concealment algorithm based on backward MV projection. This algorithm avoids using the corrupted picture and can decode the subsequent frames with the reference of the last correctly received picture. If compared with existing concealment based on forward MV projection, the proposed technique is much simpler for implementation.
3. In order to find a trade-off between the coding efficiency and the performance of concealment, we propose a partial MV correction algorithm. With the adjustment of the controlling factor, we can not only avoid the increment of motion compensation residual due to MV correction, but also preserve the improvement of error concealment.
4. Finally we also consider the case when B frames are present. We propose a new GOP structure to disconnect successive P frames in order to release the error propagation problem when some P frames are lost. With the corresponding concealment, we indeed improve the quality of the received video sequences.
Bibliography
[1] Thomas Wiegand, Gary J. Sullivan, Gisle Bjontegaard, and Ajay Luthra,
“Overview of the H.264/AVC Video Coding Standard,” IEEE Trans. on Circuits Syst. Video Technol., Vol. 13, No. 7, pp.560 – 576, July 2003
[2] Iain E G Richardson, H.264 and MPEG-4 Video Compression, John Wiley, 2003 [3] Thomas Stockhammer, Miska M. Hannuksela, and Thomas Wiegand,
“H.264/AVC in Wireless Environment,” IEEE Trans. on Circuits Syst. Video Technol., Vol. 13, No. 7, pp. 657-671, July 2003
[4] Stephan Wenger, “H.264/AVC Over IP,” IEEE Trans. on Circuits Syst. Video Technol., vol. 13, No. 7, pp. 645-656, July 2003
[5] Thomas Stockhammer, Thomas Wiegand, Tobias Oelbaum, and Florian Obermeier, “Video coding and transport layer techniques for H.264/AVC-based transmission over packet-lossy networks,” Proceedings of IEEE International Conference on Image Processing (ICIP 2003), Vol. 3, pp. 481-484, September 2003.
[6] J. Klaue, B. Rathke, and A. Wolisz, "EvalVid – A Framework for Video Transmission and Quality Evaluation", Proceedins of the 13th International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, Urbana, Illinois, USA, pp. 255-272, September 2003.
[7] Chih-Heng Ke, Cheng-Han Lin, Ce-Kuen Shieh, Wen-Shyang Hwang, “A Novel Realistic Simulation Tool for Video Transmission over Wireless Network＂, Proceedings of IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC2006), pp. 275-283, June 5-7, 2006
[8] Network Simulator, http://www.isi.edu/nsnam/ns/
[9] Zhang Rongfu, Zhou Yuanhua, and Huang Xiaodong, “Content-adaptive spatial error concealment for video communication,” IEEE Trans. on Consumer Electronics, vol. 50, pp. 335-341, Feb. 2004.
[10] Olivia Nemethova, Ameen Al-Moghrabi and Markus Rupp, “Flexible Error Concealment for H.264 Based on Directional Interpolation,” Proceedins of International Conference on Wireless Networks, Communications and Mobile Computin, vol. 2, pp. 1255-1260, June 2005.
[11] Steven Beesley, Andrew Armstrong, Christos Grecos, “An Edge Preserving Spatial Error Concealment Technique for the H.264 Video Coding Standard,”
Research in Microelectronics and Electronics 2006, Ph. D., pp 113-116, June 2006.
[12] W. M. Lam, A. R. Reibman, and B. Liu, “Recovery of lost or erroneously received motion vectors,” Proceedins of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 93), pp. 417-420, Apr. 1993.
[13] E. T. Kim, S.-J. Choi, and H.-M. Kim, “Weighted boundary matching algorithm for error concealment in the MPEG-2 video bit stream,” Signal Processing., vol.
73, pp. 291–295, Mar. 1999.
[14] Yan Chen, Au, O., Chiwang Ho, and Jiantao Zhou, “Spatio-temporal boundary matching algorithm for temporal error concealment,” Proceeedings of IEEE International Symposium on Circuits and Systems, pp. 686-689, May 2006.
[15] Agrafiotis, D., Bull, D.R., Canagarajah, C.N., “Enhanced Error Concealment With Mode Selection,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 16, pp. 960-973, August 2006.
[16] M. E. Al-Mualla, C. N. Canagarajah, and D. R. Bull, “Error concealment using motion field interpolation,” Proceedings of IEEE International Conference on Image Processing, Vol. 2, pp. 512—516, October 1998.
[17] Jinghong Zheng, Lap-Pui Chau, “A temporal error concealment algorithm for H.264 using Lagrange interpolation,” Proceeedings of IEEE International Symposium on Circuits and Systems, vol. 2, May 2004.
[18] Jae-Young Pyun, Jun-Suk Lee, Jin-Woo Jeong, Jae-Hwan Jeong, and Sung-Jea Ko, “Robust error concealment for visual communications in burst-packet-loss networks,” IEEE Trans. on Consumer Electronics, vol. 49, pp. 1013-1019, November 2003
[19] S. Gnavi, M. Grangetto, E. Magli, and G. Olmo, “Comparison of rate allocation strategies for H.264 video transmission over wireless lossy correlated networks,”
Proceedings of IEEE International Confereence on Multimedia and Expo, 2003, pp. 517-520, July 2003.
[20] E. N. Gilbert, “Capacity of a burst-noise channel,” Bell Syst. Tech. J., vol. 39, pp.
1253-1265, Sept. 1960.
[21] E. 0. Elliott, “Estimates of error rates for codes on burst-noise channels,” Bell Syst. Tech. J., vol. 42, pp. 1977-1997, Sept. 1963.
[22] S. Belfiore, M. Grangetto, E. Magli, G. Olmo, “Concealment of whole-frame loss for wireless low bit-rate video based on multiframe optical flow estimation,”
IEEE Transactions on Multimedia, vol. 7, no. 2, pp. 316-329, Apr. 2005.
[23] S. Belfiore, M. Grangetto, E. Magli, G. Olmo, “ An error concealment algorithm for streaming video,＂Proceedings of IEEE International Conference on Image Processing, pp. 649-652, 2003.
[24] Baccichet, P.;and Chimienti, A., “A low complexity concealment algorithm for the whole-frame loss in H.264/AVC,” Proceedings of IEEE 6th Workshop on Multimedia Signal Processing, pp. 279-282, October 2004.
[25] P. Baccicht, D. Bagni, A. Chimienti, L.Pezzoni, and F. Rovati, “Frame concealment for H.264/AVC decoders,＂ IEEE Transactions on Consumer Electronics, vol. 51, no. 1, pp. 227-233, Feb. 2005.
[26] Zhenyu Wu and J. M. Boyce, “An error concealment scheme for entire frame losses based on H.264/AVC,＂Proceedings of IEEE International Symposium on Circuits and Systems ( ISCAS 2006), pp. 4463-4466, May 2006.
[27] A. M. Tekalp, “Digital Video Processing.” Englewood Cliffs, NJ: Prentice- Hall, 1995.