Digital image sequences that have been acquired by hand-held, in-car or fixed-type surveillance video cameras are usually affected by the undesired motions produced by hand-shaking , bumpy rides, and many other external forces. The unwanted positional fluctuations of the image sequence will affect the visual quality and impede the subsequent processes for various applications. Although undesired motions are usually irregular and uneven compared to intentional global motions, the challenge of image stabilization systems is how to compensate for the unwanted shaking of the camera, without being influenced by the object moving in the image or by an intentional motion. In this dissertation research works, the related problems have been partially solved. The major contributions are summarized as:
(1) The local motion estimation algorithm is proposed by using the inverse triangle method to evaluate the reliability of a calculated local motion vector, and then generate a refined motion vector with a reliability index to form a set of selected local motion vectors which can determine the global motion vector robustly. (This research work has been published in "A robust digital image stabilization technique based on inverse triangle method and background detection," IEEE Trans. on Consumer Electronics, vol. 51, no. 2, pp. 335 - 345, May 2005 (SCI) and granted in Taiwan invention patent 泛用型數位影像防振系統與方法。中華民國發明專利 I307443 號 2009/03/11.).
(2) To improve the robustness of global motion estimation, skyline detection and background based peer to peer evaluation are proposed. The background based peer to peer evaluation solves the large moving object problem and reduces artificial shaking in DIS. The skyline detection uses the coarse skyline to adjust the background-based evaluation area. It can prevent the invalid result due to some of the five regions located on the low-contrast area. (This research work has been published in "A Robust In-Car Digital Image Stabilization Technique," IEEE Trans. on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 37, no. 2, pp. 234-247, Mar. 2007 (SCI)).
(3) The optimization of selecting the representative points from the background image in the fixed-type video surveillance application is proposed to reduce the computation complexity. (This research work has been published in "Digital Image Stabilization Technique and its Application to Video Surveillance System," 2006 MIICS Mechatronic and Industry Interact Cross Strait Conference pp. 309-314, Hsinchu Taiwan, Nov. 23 2005).
(4) The objective of motion compensation is to achieve the optimal stabilization of shaking images within a specified compensation range. The proposed FIDIS combines two motion compensation methods to adaptively determine a better method for motion compensation. It solves the problem of lag and overshoot of motion trajectory. The proposed FIDIS shows effective improvements in different conditions of image sequence through the evaluations of a smoothness index and motion trajectory. (This research work has been published in "Fuzzy Inference Applied to Digital Image Stabilization Techniques," Journal of Image Processing and Pattern Recognition, vol. 13, no. 3, pp. 55-66, 2007.(Domestic Journal)).
.
Bibliography
[1] M. Oshima, et al., “VHS camcorder with electronic image stabilizer,” IEEE Trans. on Consumer Electronics, vol. 35, no. 4, pp. 749-758, Nov. 1989.
[2] K. Sato, et al., “Control techniques for optical image stabilizing system,” IEEE Trans.
on Consumer Electronics, vol. 39, no. 3, pp. 461-466, Aug. 1993.
[3] S. C. Hsu, S. F. Liang, C. T. Lin, "A robust digital image stabilization technique based on inverse triangle method and background detection," IEEE Transactions on Consumer Electronics, vol. 51, no. 2, pp. 335 - 345, May 2005.
[4] S. J. Ko, S. H. Lee, and K. H. Lee, “Digital image stabilizing algorithms based on bit-plane matching,” IEEE Tran. on Consumer Electronics, vol. 44, no. 3, pp. 617-622, Aug. 1998.
[5] K. Uomori, et al., “Automatic image stabilizing system by full-digital signal processing,” IEEE Trans. on Consumer Electronics, vol. 36, no. 3, pp. 510-519, Aug.
1990.
[6] Y. Egusa, et al., “An application of fuzzy set theory for an electronic video camera image stabilizer,” IEEE Transactions on Fuzzy Systems, vol. 3, no. 3, pp. 351-356, Aug.
1995.
[7] J. K. Paik, Y. C. Park, and D. W. Kim, “An adaptive motion decision system for digital image stabilizer based on edge pattern matching,” IEEE Trans. on Consumer Electronics, vol. 38, no. 3, pp. 607-616, Aug. 1992.
[8] J. K. Paik, Y. C. Park, and S. W. Park, “An edge detection approach to digital image stabilization based on tri-state adaptive linear neurons,” IEEE Tran. on Consumer Electronics, vol. 37, no. 3, pp. 521-530, Aug 1991.
[9] S. W. Jeon, et al., “Fast digital image stabilizer based on Gray-coded bit-plane matching,” IEEE Trans. Consumer Electronics, vol. 45, no. 3, pp. 598-603, Aug. 1999.
[10] F. Vella, et al., “Digital image stabilization by adaptive block motion vectors filtering,”
IEEE Trans. on Consumer Electronics, vol. 48, no. 3, pp. 796-801, Aug. 2002.
[11] S. Erturk, “Digital image stabilization with sub-image phase correlation based global motion estimation,” IEEE Trans. on Consumer Electronics, vol. 49, no. 4, pp.
1320-1325, Nov. 2003.
[12] S. C. Hsu, S. F. Liang, and C. T. Lin, "Digital Image Stabilization Technique and its Application to Video Surveillance System," 2005 MIICS Mechatronic and Industry Interact Cross Strait Conference, pp. 309-314, Hsinchu Taiwan, Nov. 23 2005.
[13] S. C. Hsu, S. F. Liang, K. W. Fan and C. T. Lin, "A Robust In-Car Digital Image Stabilization Technique," IEEE Transactions on Systems, Man, and Cybernetics, Part C:
Applications and Reviews, vol. 37, no. 2, pp. 234-247, Mar. 2007.
[14] L. Xu, and X. Lin, "Digital image stabilization based on circular block matching," IEEE Transactions on Consumer Electronics, vol. 52, no. 2, pp. 566 - 574, May 2006.
[15] J. Y. Chang, et al., “Digital image translational and rotational motion stabilization using
optical flow technique,” IEEE Trans. on Consumer Electronics, vol. 48, no. 1, pp.
108-115, Feb. 2002.
[16] J. S. Jin, Z. Zhu, and G. Xu, “A stable vision system for moving vehicles,” IEEE Trans.
on Intelligent Transportation Systems, vol. 1, no. 1, pp. 32-39, Mar. 2000.
[17] G. R. Chen, et al., “A novel structure for digital image stabilizer,” Proc. of 2000 IEEE Asia-Pacific Conference on Circuits and Systems, pp. 101-104, 2000.
[18] Engelsberg, G. Schmidt, “A comparative review of digital image stabilising algorithms for mobile video communications,” IEEE Transactions on Consumer Electronics, Vol.
45, no 3, pp. 591-597 Aug. 1999
[19] M.B. van Leeuwen. “Motion estimation and interpretation for in-car systems,” PhD thesis, Informatics Institute, University of Amsterdam, The Netherlands, May 2002.
[20] S. Erturk, “Image sequence stabilisation: motion vector integration (MVI) versus frame position smoothing (FPS),” Proc. of the 2nd International Symposium on Image and Signal Processing and Analysis, pp. 266-271, 2001.
[21] M. K. Gullu, S. Erturk, “Membership function adaptive fuzzy filter for image sequence stabilization,” IEEE Trans. on Consumer Electronics, vol. 50, no. 1, pp. 1-7, Feb. 2004.
[22] M. K. Kim, E. Kim, D. Shim et al., "An efficient global motion characterization method for image processing applications," IEEE Trans. on Consumer Electronics, vol. 43, no.
4, pp. 1010-1018, Nov. 1997.
[23] J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," International Journal of Computer Vision, vol. 12, no. 1, pp. 43-77, 1994.
[24] S. BEAUCHEMIN S., and L. BARRON J., "The Computation of Optical Flow," ACM Computing Surveys, vol. l 27, no. 3, pp. 433-467, Sep. 1995.
[25] F. Dufaux, and F. Moscheni, "Motion estimation techniques for digital TV: a review and a newcontribution," Proceedings of the IEEE, vol. 83, no. 6, pp. 858-876, Jun. 1995.
[26] A. Bainbridge-Smith, and R.G. Lane, "Determining optical flow using a differential method," Image and Vision Computing, vol. 15, no. 1, pp. 11-22, Jan. 1997.
[27] A. Giachetti, "Matching techniques to compute image motion," Image and Vision Computing, vol. 18, no. 3, pp. 247-260, Feb. 2000.
[28] Barbara Zitová, Jan Flusser, and, "Image registration methods: a survey," Image and Vision Computing, vol. 21, no. 11, pp. 977-1000, Oct. 2003.
[29] T. Ha, S. Lee, and J. Kim, "Motion compensated frame interpolation by new block-based motion estimation algorithm," IEEE Trans. on Consumer Electronics, vol.
50, no. 2, pp. 752 - 759, May 2004.
[30] Y. W. Huang, S. Y. Chien, B. Y. Hsieh et al., "Global elimination algorithm and architecture design for fast block matching motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 14, no. 6, pp. 898 - 907, Jun. 2004.
[31] J. Fleet David, and D. Jepson Allan, "Computation of component image velocity from local phase information," International Journal of Computer Vision, vol. 5, no. 1, pp.
1573-1405, Aug. 1990.
[32] D. J. Fleet, and A. D. Jepson, "Stability of phase information," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 12, pp. 1253-1268, 1993
[33] David Vernon, "Computation of instantaneous optical flow using the phase of Fourier components," Image and Vision Computing, vol. 17, no. 3-4, pp. 189-199, Mar. 1999.
[34] S. Erturk, "Digital image stabilization with sub-image phase correlation based global motion estimation," IEEE Transactions on Consumer Electronics, vol. 49, no. 4, pp.
1320-1325, Nov. 2003.
[35] Pierre-Yves Burgi, and, "Motion estimation based on the direction of intensity gradient,"
Image and Vision Computing, vol. 22, no. 8, pp. 637-653, 2004.
[36] D. J. Fleet, and K. Langley, "Recursive filters for optical flow," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 1, pp. 61-67, 1995.
[37] S. BEAUCHEMIN S., and L. BARRON J., "The Computation of Optical Flow," ACM Computing Surveys, vol. l 27, no. 3, pp. 433-467, Sep. 1995.
[38] S. Erturk, T. J. Dennis, and, "Image sequence stabilisation based on DFT filtering," IEE Proceedings of Vision, Image and Signal Processing,, vol. 147, no. 2, pp. 95-102, Apr.
2000.
[39] H. Adelson Edward, and R. Bergen James, "Spatiotemporal energy models for the perception of motion," JOSA A, vol. 2, no. 2, pp. 284-299, 1985.
[40] J. R. Jain, and A. K. Jain, "Displacement measurement and its application in interframe image coding," IEEE Tran. on Communications, vol. 29, no. 12, pp. 1799-1808, Dec.
1981
[41] T. Koga, K. Iinuma, A. Hirano et al., "Motion compensated interframe coding for video conferencing," Proceedings of National Telecommunications Conference, pp.
C9.6.1-C9.6.5, 1981.
[42] R. Li, B. Zeng, and M. L. Liou, "A new three-step search algorithm for block motion estimation," IEEE Transactions on Circuits and Systems for Video Technology, vol. 4, no. 4, pp. 438 - 442, Aug. 1994.
[43] K. Seth, P. Rangarajan, S. Srinivasan et al., "A parallel architectural implementation of the New Three-Step Search algorithm for block motion estimation," Proc. 17th International Conference on VLSI Design, 2004., pp. 1071 - 1076, 2004.
[44] S. Zhu, K. K. Ma, "A new diamond search algorithm for fast block matching motion estimation," Proceedings of 1997 International Conference on Information, Communications and Signal Processing, 1997. ICICS., pp. 292 - 296, 9-12 Sep. 1997.
[45] J. B. Xu, L. M. Po, and C. K. Cheung, "Adaptive motion tracking block matching algorithms for video coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, no. 7, pp. 1025 - 1029, Oct. 1999.
[46] J. L. Chen, and P. Y. Chen, "An efficient gray search algorithm for the estimation of motion vectors," IEEE Transactions on Systems, Man and Cybernetics, Part C, vol. 31, no. 2, pp. 242-248, May 2001.
[47] M. J. Chen, L. G. Chen, and T. D. Chiueh, "One-dimensional full search motion estimation algorithm for video coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 4, no. 5, pp. 504 - 509, Oct. 1994.
[48] L. M. Po, and W. C. Ma, "A novel four-step search algorithm for fast block motion estimation," IEEE Transactions on Circuits and Systems for Video Technology, vol. 6, no. 3, pp. 313 - 317, Jun. 1996.
[49] B. Liu, A. Zaccarin, "New fast algorithms for the estimation of block motion vectors,"
IEEE Transactions on Circuits and Systems for Video Technology, vol. 3, no. 2, pp. 148 - 157, Apr. 1993.
[50] L. Chen, and N. Tokuda, "A general stability analysis on regional and national voting schemes against noise-why is an electoral college more stable than a direct popular election?," Artificial Intelligence, vol. 163, no. 1, pp. 47-66, March, 2005.
[51] M. J. Chen, L. G. Chen, T. D. Chiueh et al., "A new block-matching criterion for motion
estimation and its implementation," IEEE Transactions on Circuits and Systems for Video Technology,, vol. 5, no. 3, pp. 231 - 236, Jun. 1995.
[52] S. Garg, and S. N. Merchant, "Interpolated Candidate Motion Vectors for Boundary Matching Error Concealment Technique in Video," IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 53, no. 10, pp. 1039 - 1043.
[53] Z. L. He, C. Y. Tsui, K. K. Chan et al., "Low-power VLSI design for motion estimation using adaptive pixel truncation," IEEE Transactions on Circuits and Systems for Video Technology, vol. 10, no. 5, pp. 669 - 678, Aug. 2000.
[54] Motion compensation - Wikipedia, the free encyclopedia. http://en.wikipedia.org/wiki/- Motion_compensation:2007/12/14.
[55] Y. C. Peng, M. T. Lu, and H. Chen, "DSP implementation of digital image stabilizer,"
Proc. ICME, IEEE Int'l Conference on Multimedia and Expo, pp. 4, 6-8 July 2005.
[56] Y. C. Peng, H. A. Chang, H. H. Chen et al., "Digital image stabilization and its integration with video encoder," IEEE Consumer Communications and Networking Conference, pp. 544 - 549, 3-6 Jan. 2005.
Author’s Publication List
I. Referred Papers
[1] S. C. Hsu, S. F. Liang, KW Fan and C. T. Lin, "A Robust In-Car Digital Image Stabilization Technique," IEEE Trans. on Systems, Man, and Cybernetics, Part C:
Applications and Reviews, vol. 37, no. 2, pp. 234-247, Mar. 2007.(SCI)
[2] S. C. Hsu, S. F. Liang, and C. T. Lin, "A robust digital image stabilization technique based on inverse triangle method and background detection," IEEE Trans. on Consumer Electronics, vol. 51, no. 2, pp. 335 - 345, May 2005.(SCI)
II. Conference Papers
[1] S. C. Hsu, and T. S. Chen, "The Research of Image Motion Blurring Effect and Restoration," 2008 MIICS Mechatronic and Industry Interact Cross Strait Conference (in Chinese, pp. 329-333, Hsinchu Taiwan, Nov. 12 2008.
[2] T. S. Chen, and S. C. Hsu, "Image Features Extration by Automatic Multilevel Thresholding," 2007 MIICS Mechatronic and Industry Interact Cross Strait Conference (in Chinese), pp. 18-21, Hsinchu Taiwan, Nov. 7 2007.
[3] T. S. Chen, and S. C. Hsu, "Automatic Threshold Selection from Gray Level Histogram,"
2006 MIICS Mechatronic and Industry Interact Cross Strait Conference (in Chinese), pp.
493-497, Hsinchu Taiwan, Nov. 1 2006.
[4] S. C. Hsu, T. S. Chen, and H. L. Liao, "Dual Mode Design of Temperature and Humidity Control," 2006 MIICS Mechatronic and Industry Interact Cross Strait Conference (in Chinese), pp. 409-414, Hsinchu Taiwan, Nov. 1 2006.
[5] Y. C. Cheng, J. F. Chung, C. T. Lin, S. C. Hsu, "Local motion estimation based on cellular neural network technology for image stabilization processing," The 2005 9th International Workshop on Cellular Neural Networks and Their Applications, pp. 286 - 289, 28-30 May 2005.
[6] S. C. Hsu, S. F. Liang, and C. T. Lin, "Digital Image Stabilization Technique and its Application to Video Surveillance System," 2005 MIICS Mechatronic and Industry Interact Cross Strait Conference (in Chinese), pp. 309-314, Hsinchu Taiwan, Nov. 23 2005.
[7] S. C. Hsu, "The LabVIEW Based Battery Capacity Measure System," The 2004 Seminar and Symposiumon of Harmonic and Grounding Engineering Technology (in Chinese), pp. 43-48, Hsinchu Taiwan, Oct. 1 2004.
[8] S. C. Hsu, et al., "The e-lab Management and Control," The 2003 Seminar and Symposiumon of Photo and Semiconductor Technology (in Chinese), pp. 18-22, Hsinchu Taiwan, Nov. 28 2003.
[9] T. M. Chen, and S. C. Hsu, "The Design of PLC SCADA Teaching System," The 2001
Seminar and Symposiumon of Applied Power electronics Technology (in Chinese), pp.
91-94, Hsinchu Taiwan, Nov. 23 2001.
[10] S. C. Hsu, "The Technology of Fingerprint Verification," The 2001 Seminar and Symposiumon of Applied Power electronics Technology (in Chinese), pp. 48-50, Hsinchu Taiwan, Nov. 23 2001.
III. Patents
[1] 林進燈、徐聖哲、梁勝富。2009/03/11。泛用型數位影像防振系統與方法。中華民 國發明專利I307443 號.
Vita
徐聖哲
學經歷：
1. 62 年 9 月～65 年 6 月 台灣省立台南第一高級中學 2. 65 年 9 月～69 年 6 月 中原理工學院電機工程系
3. 71 年 9 月～76 年 9 月 工業技術研究院機械工業研究所助理/副研 究員
4. 76 年 9 月～78 年 6 月 美國紐澤西理工學院電機工程研究所碩士 進修
5. 78 年 8 月～79 年 1 月 工業技術研究院機械工程研究所副研究員 6. 79 年 2 月～81 年 7 月 福祿遠東股份有限公司工程部資深工程師 7. 81 年 8 月～95 年 1 月 大華技術學院電機工程系專任講師
8. 89 年 9 月～Now 國立交通大學電機與控制工程學系博士進 修
9. 96 年 2 月～97 年 2 月 大華技術學院電機工程系專任副教授
10. 97 年 3 月～Now 大華技術學院電機工程系專任副教授兼系 主任