Resolution Enhancement Technique Based on Spatio-temporal Analysis 賴敏寬、林國祥
E-mail: [email protected]
ABSTRACT
Resolution enhancement is a basic and important technology in image/video processing. In this paper, an adaptive resolution enhancement scheme was proposed. The goal of the proposed scheme is to reconstruct high-resolution image frames from the corresponding low-resolution versions. After giving initial estimates obtained from the spatial and temporal domains, interpolated images are reconstructed by using adaptive iterative back-projection and then fused to be a high-resolution one. Finally, a post-processing is utilized to reduce the blocking artifacts within the reconstructed high-resolution images. According to the experimental results, in terms of PSNR and NQM, the reconstructed results by the proposed scheme are better than those by three existing methods for comparison.
Keywords : resolution enhancement ; iterative back-projection （IBP） ; subpixel image Table of Contents
封面內頁 簽名頁 授權書 iii 中文摘要 iv ABSTRACT v 誌謝 vi 目錄 vii 圖目錄 ix 表目錄 xiv 第一章 緒論 1 1.1 研究動機 1 1.2 基本問題模型定義 3 1.3 文獻回顧 4 1.3.1 單張影像解析度增強方法 4 1.3.2 多張低解析度影像增強方法 6 第二章 單張影像解 析度之增強 8 2.1 系統架構 8 2.2 次像素影像之產生 9 2.3 影像邊緣偵測 10 2.4 高解析度影像初始解產生與具邊緣保留之IBP 法則 14 2.5 影像融合 18 2.6 邊緣效應之修正 19 第三章 多張影像解析度之增強 22 3.1 多張影像解析度增強之系統架構 22 3.2 移動向量之估計 23 3.3 移動向量之修正 27 3.4 高解析度影像產生與融合 31 第四章 實驗結果與分析 33 4.1 定義評估標準 與系統執行環境 33 4.2 實驗說明 34 4.3 單張影像解析度增強結果 35 4.4 多張影像解析度增強結果 63 第五章 結論與未來研 究方向 82 5.1 結論 82 5.2 未來研究方向 83 參考文獻 84
REFERENCES
[1] R. C. Gonzalez and R. E. Woods, Digital Image Processing, second edition, Addison Wesley.
[2] R.G. Keys, “Cubic convolution interpolation for digital image processing,” IEEE International Conference on Acoustics, Speech, Signal Processing vol. 29, no. 6, pp. 1153-1160, Dec. 1981.
[3] Mei-Juan Chen, Chin-Hui Huang, and Wen-Li Lee, “A fast edge-oriented algorithm for image interpolation,” Image and Vision Computing, vol. 23, no. 9, pp. 791-798, Sep. 2005.
[4] L. Rodrigues, D. Leandro Borges, and L. Marcos Gonalves, “A locally adaptive edge-preserving algorithm for image interpolation,” IEEE Proceedings XV Brazilian Symposium on Computer Graphics and Image Processing, pp. 300-305, Oct. 2002.
[5] R. Y. Tasi and T. S. Huang, “Multiframe image restoration and registration,” Advance in Computer Vision and Image Processing, Vol. 1, JAI Press, Greenwich, CT, pp.317-339, 1984 [6] Zhang Di, Huifang Li, and Minghui Du, “Fast MAP-based multiframe super-resolution image reconstruction,” Image and Vision Computing, vol. 23, on. 7, pp. 671-679, Jul. 2005.
[7] H. Stark and P. Oskoui, “High-resolution image recovery from image-plane array, using convex projections,” J. Optical Society of America, vol. 6, no. 11, pp. 1715-1726, Nov. 1989.
[8] A. M. Tekaop, M. K. Ozkan and M. I. Sezan, “High-resolution image reconstruction from lower-resolution images sequences and space-varying image restoration,” IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 3, pp. 169-172, Mar. 1992.
[9] Shengyang Dai, Mei Han, Ying Wu, and Yihong Gong, “Bilateral back-projection for single image super resolution,” IEEE International Conference on Multimedia and Expo, pp. 1039-1042, 2007.
[10] R. Y. Tasi, T. S. Huang, “Multiframe Image Restoration and Registration,” Advance in Computer Vision and Image Processing, vol. 1, pp.
317-339, 1984.
[11] H. Stark and P. Ozkan, “High-Resolution Image Recovery From Image-Plane Arrays, Using Convex Projections,” J. Optical Society of America, vol. 6, no. 11, pp. 1715-1726, 1989.
[12] P. Cheesman, B. Kanefsky, R. Kraft, J. Stutz, and R. Hanson, “Super-resolved surface reconstruction form multiple images,” Technical Report FIA-94-12, NASA Ames Research Center, Moffett Field, CA, 1994.
[13] Yan Cheng, Xiangzhong Fang, Jun Hou, and Songyu Yu, “Multiframe super-Resolution reconstruction based on cycle-spinning,” IEEE
International Conference on Acoustics, Speech and Signal Processing, vol. 1, pp. I-557-I-560, 2007.
[14] H. Greenspan, G. Oz, N. Kiryati, and S. Peled, “MRI inter-slice reconstruction using super-resolution,” Magnetic Resonance Imaging, vol.
20, pp. 437-446, 2002.
[15] 戴顯權，陳瀅如，王春清，多媒體通訊 原理標準與系統 第二版，紳藍出版社。
[16] 賴駿銘，結合空間與動量特徵分析之MPEG-4新聞視訊摘要系統，碩士論文，國立中正大學電機工程研究所。
[17] N. Damera-Venkata, T. D. Kite, W. S. Geisler, B. L. Evans, and A. C. Bovik, ”Image quality assessment based on a degradation model,”
IEEE Trans. Image Processing, vol. 9, no. 4, pp. 636-650, 2000.
