A new two-stage mixed noise removal scheme for images is proposed in this thesis. In the first stage, the decision-based recursive adaptive median filter is applied to remove the Salt-Pepper noise and an adaptive two-level neural network noise reduction procedure is applied to remove the random-valued noise, and keep the uncorrupted information well. Then the fuzzy decision rules inspired by human visual system (HVS) applied to compensate the blur of the edge and the destruction caused by median filter. In the second stage, the MFRB filter is validated to suppress the Gaussian noise and preserve the image details and structures very well. For practical application, we combine the proposed Salt-Pepper noise removal algorithm and universal MFRB filter, together with the Gaussian noise level estimation routine, to sequentially remove the mixed noise in an image. According to the experiment results, the proposed method is superior to the conventional methods in the perceptual image quality and it can provide a quite stable performance over a wide variety of images with various noise densities. The proposed two-stage filtering scheme has demonstrated the effectiveness and robustness, in comparison with other filters in mixed noise removal of images.
References
[1] T. A. Nodes and N. C. Gallagher, “Median Filters: Some Modifications and Their Properties,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP−30, pp.
739−746, Oct. 1982.
[2] G. R. Arce and R. J. Crinon, “Median Filters: Analysis for Two-Dimensional Recursively Filtered Signals,” in Proc. Int. Conf. on Acoust., Speech, and Signal Processing, pp. 20.11.1−20.11.4, 1984.
[3] D. Brownrigg, “The Weighted Median Filter,” Commun. Assoc. Computer, pp.
807−818, Mar. 1984.
[4] R. Yang and L. Yin, “Optimal Weighted Median Filtering Under Structural Constrains,” IEEE Trans. Signal Processing, vol. 43, no. 3, pp. 591−604, Mar.
1995.
[5] S. J. Ko and Y. H. Lee, “Center Weighted Median Filters and Their Applications to Image Enhancement,” IEEE Trans. Circuits Syst., vol. 38, no. 9, pp. 984−993, Sep. 1991.
[6] H. M. Lin and A. N. Willson, “Median Filters with Adaptive Length,” IEEE Trans. Circuits Syst., vol. 35, no. 6, pp. 675−690, June 1988.
[7] M. P. McLoughlin and G. R. Arce, “Deterministic Properties of the Recursive Separable Median Filter,” IEEE Trans. Acoust., Speech, Signal Processing, vol.
ASSP-35, pp. 98−106, 1987.
[8] G. Qiu, “An Improved Recursive Median Filtering Scheme for Image Processing,” IEEE Trans. Image Processing, vol. 5, no. 4, pp. 646−648, Apr.
1996.
[9] J. B. Bednar and T. L. Watt, “Alpha-trimmed Means and Their Relationship to Median Filters,” IEEE Trans. Acoust., Speech, and Signal Processing, Vol.
ASSP−32, pp. 145−153, 1984.
[10] D. A. F. Florencio and R. W. Schafer, “Decision-Based Median Filter Using Local Signal Statistics,” in Proc. SPIE Symp. Vis. Comm. Image Processing, vol.
2308, pp. 268−275, 1994.
[11] H. Kong and L. Guan, “A Noise-Exclusive Adaptive Filtering Framework for Removing Impulse Noise in Digital Images,” IEEE Trans. Circuits Syst. Ⅱ, vol.
45, no. 3, pp. 422−428, Mar. 1998.
[12] G. Pok and J. C. Liu, “Decision-Based Median Filter Improved by Predictions,”
in Proc. IEEE Int. Conf. on Image Processing, pp. 410−413, 1999.
[13] E. Abreu and S. K. Mitra, “A Signal-Dependent Rank Ordered Mean (SD-ROM) Filter – A New Approach for Removal of Impulses from Highly Corrupted Images,” in Proc. IEEE Int. Conf. on Acoust., Speech, and Signal Processing, vol.
4, pp. 2371−2374, May 1995.
[14] T. Chen, K. K. Ma, and L. H. Chen, “Tri-State Median Filter for Image De-noising,” IEEE Trans. Image Processing, vol. 8, no. 12, pp. 1834−1838, Dec.
1999.
[15] T. Chen and H. R. Wu, “Impulse Noise Removal by Multi-State Median Filtering,” in Proc. IEEE Int. Conf. on Acoust., Speech, and Signal Processing, vol. 4, pp. 2183−2186, Jun. 2000.
[16] H. L. Eng and K. K. Ma, “Noise Adaptive Soft-Swtching Median Filter,” IEEE Trans. Image Processing, vol. 10, no. 2, pp. 242−251, Feb. 2001.
[17] S. Zhang and M. A. Karim, “A New Impulse Detector for Switching Median Filters,” IEEE Signal Processing Lett., vol. 9, no. 11, pp. 360−363, Nov. 2002.
[18] Z. Wang and D. Zhang, “Progressive Switching Median Filter for the Removal
of Impulse Noise from Highly Corrupted Images,” IEEE Trans. Circuits Syst. Ⅱ, vol. 46, no. 1, pp. 78−80, Jan. 1999.
[19] C. T. Chen and L. G. Chen, “A Self-Adjusting Weighted Median Filter for Removing Impulse Noise in Image,” in Proc. IEEE Int. Conf. on Image Processing, vol. 1, pp.419−422, Sept. 1996.
[20] G. R. Arce and J. L. Paredes, “Recursive Weighted Median Filters Admitting Negative Weights and Their Optimization,” IEEE Trans. Signal Processing, vol.
48, no. 3, pp. 768−779, Mar. 2000.
[21] T. Chen and H. R. Wu, “Application of Partition-Based Median Type Filters for Suppressing Noise in Images,” IEEE Trans. Image Processing, vol. 10, no. 6, pp.
829−836, June 2001.
[22] K. Kondo, M. Haseyama and H. Kitajima, “An Accurate Noise Detector for Image Restoration,” in Proc. IEEE Int. Conf. on Image Processing, vol. 1, I-321
−I-324, Sep. 2002.
[23] I. Aizenberg, C. Butakoff, and D. Paliy, “Impulsive Noise Removal Using Threshold Boolean Filtering Based on the Impulse Detecting Functions,” IEEE Signal Processing Lett., vol. 12, no. 1, pp. 63−66, Jan. 2005.
[24] X. Li and M. Orchard, “True Edge-Preserving Filtering for Impulse Noise Removal,” in Proc. 34th Asilomar Conf. on Signals, Systems and Computers, Pacific Grove CA, Oct. 2000.
[25] R. H. Chan, C. W. Ho, and M. Nikolova, “Salt-and-Pepper Noise Removal by Median-Type Noise Detectors and Detail-Preserving Regularization,” IEEE Trans. Image Processing, vol. 14, no. 10, pp. 1479−1485, 2005.
[26] T. Z. Lin and P. T. Yu, “Thresholding Noise-Free Ordered Mean Filter Based on Dempster-Shafer Theory for Image Restoration,” IEEE Trans. Syst., Man, Cybern. I, vol. 53, no. 5, pp. 1057−1064, May 2006.
[27] J. S. Lim, Two-Dimensional Signal and Image Processing, Englewood Cliff, N. J:
Prentice-Hall, 1990.
[28] J. W. Woods and C. H. Radewan, “Kalman Filtering in Two Dimensions,” IEEE Trans. Inform. Theory, vol. IT-23, pp. 473−482, July 1977.
[29] L. Yin, and Y. Neuvo, “Adaptive FIR-WOS Filtering.” in Proc. IEEE Int. Conf.
on Symp. Circuits Syst., vol. 6, pp. 2637−2640, May 1992.
[30] A. Taguchi, M. Muneyasu, and T. Hinamoto, “Median and Neural Networks Hybrid Filters,” in Proc. IEEE Int. Conf. on Neural Networks, vol. 1, pp.
580−583, Dec. 1995.
[31] R. Garnett, T. Huegerich, C. Chui, and W. He, “A Universal Noise Removal Algorithm with an Impulse Detector,” IEEE Trans. Image Processing, vol. 14, no.
11, pp. 1747−1754, Nov. 2005.
[32] C. Tomasi and R. Manduchi, “Bilateral Filtering for Gray and Color Images,” in Proc. IEEE Int. Conf. on Computer Vision, pp. 839−846, 1998.
[33] D. Zhang and Z. Wang, "Impulse Noise Detection and Removal Using Fuzzy Techniques," Electronics Lett., vol. 33, no. 5, pp. 378−379, Feb. 1997.
[34] S. Schulte, et al., “A Fuzzy Impulse Noise Detection and Reduction Method,”
IEEE Trans. Image Processing, vol. 15, no. 5, pp. 1153−1162, May 2006.
[35] C. S. Lee, S. M. Guo, and C. Y. Hsu, “Genetic-Based Fuzzy Image Filter and its Application to Image Processing, IEEE Trans. Syst., Man and Cybern. B, vol. 35, no. 4, pp. 694−711, 2005.
[36] F. Russo, “Noise Removal from Image Data Using Recursive Neurofuzzy Filter,”
IEEE Trans. Instrum. Meas., vol. 49, no. 2, pp. 307–314, Apr. 2000.
[37] F. Russo, “An Image Enhancement Technique Combining Sharpening and Noise Reduction,” IEEE Trans. Instrum. Meas, vol. 51, no. 4, pp. 824–828, Aug. 2002.
[38] M. E. Yüksel, and E. Beşdok, “A Simple Neuro-Fuzzy Impulse Detector for
Efficient Blur Reduction of Impulse Noise Removal Operators for Digital Images,” IEEE Trans. Fuzzy Syst., vol. 12, no. 6, Dec. 2004.
[39] H. S. Wong and L. Guan, “A Neural Learning Approach for Adaptive Image Restoration Using a Fuzzy Model-Based Network Architecture,” IEEE Trans.
Neural Networks, vol. 12, no. 3, May 2001.
[40] D. V. D. Ville, et al., “Noise Reduction by Fuzzy Image Filtering,” IEEE Trans.
Fuzzy Syst., vol. 11, no. 4, pp.429−436, Aug. 2003.
[41] C. Jing, Y. Jinsheng, and D. Runtao, “Fuzzy Weighted Average Filter,” in Proc.
IEEE Int. Conf. on Signal Processing, pp. 525−528, 2000.
[42] A. Taguchi, “A Design Method of Fuzzy Weighted Median Filters,” in Proc.
IEEE Int. Conf. on Image Processing, vol. 1, pp. 423−426, 1996.
[43] S. Peng and L. Lucke, “Fuzzy Filtering for Mixed Noise Removal During Image Processing,” in Proc. IEEE Int. Conf. on Fuzzy Systems, vol. 1, pp. 89−93, June 1994.
[44] S. Peng and L. Lucke, “Multi-Level Adaptive Fuzzy Filter for Mixed Noise Removal,” IEEE Int. Symp. on Circuits Syst., vol. 2, pp. 1524−1527, May 1995.
[45] M. Muneyasu et al., “An Edge-Preserving Fuzzy Filter Based on Differences Between Pixels,” in Proc. IEEE Int. Conf. on Circuits Syst., vol. 5, pp. 363−366, June 1999.
[46] M. Salmeri et al., “Noise Estimation in Digital Images Using Fuzzy Processing,”
in Proc. IEEE Int. Conf. on Image Processing, vol. 1, pp. 517−520, Oct. 2001.
[47] Y. Choi and R. Krishnapuram, “A Robust Approach to Image Enhancement Based on Fuzzy Logic,” IEEE Trans. Image Processing, vol. 6, no. 6, pp.
808−825, June 1997.
[48] A. Taguchi, “Removal of Mixed Noise by Using Fuzzy Rules,” Second Int. Con.
Proc. on Knowledge-Based Intell. Electron. Syst., vol. 1, pp. 176−179, Apr. 1998.
[49] F. Farbiz, M. B. Menhaj, S. A. Motamedi, and M. T. Hagan, “A New Fuzzy Logic Filter for Image Enhancement,” IEEE Trans. Syst. Man, and Cybern. B, vol. 30, no.1, pp. 110−119, Feb. 2000.
[50] H. Qin and S. X. Yang, “Nonlinear Noise Cancellation for Image with Adaptive Neuro-Fuzzy Inference Systems,” Electronics Lett., vol. 41, no. 8, pp. 474−475, Apr. 2005.
[51] J. F. C. Wanderley and M. H. Fisher, “Multiscale Color Invariants Based on the Human Visual System,” IEEE Trans. Image Processing, vol. 10, no. 11, Nov.
2001.
[52] S. H. Kim and J. P. Allebach, “Impact of HVS Models on Model-Based Halftoning,” IEEE Trans. Image Processing, vol. 11, no. 3, Mar. 2002.
[53] H. Lin and A. N. Venetsanapoulos, “Incorporating Human Visual System (HVS) Models into the Fractal Image Compression,” in Proc. IEEE Int. Conf. on Acoust., Speech, and Signal Processing, vol. 4, pp. 1950−1953, 1996.
[54] Y. Chee and K. Park, “Medical Image Compression Using the Characteristics of Human Visual System,” in Proc. IEEE Int. Conf. on 16th Annual, vol. 1, pp.
618−619, 1994.
[55] M. Bertran, J. F. Delaigle, and B. Macq, “Some Improvements to HVS Models for Finger-printing in Perceptual Decompressors,” in Proc. IEEE Int. Conf. on Image Processing, vol. 2, pp. 1039−1042, 2001.
[56] B. Azeddine, B. B. Kamel, and B. Abdelouahab, “Low-level vision treatments inspired from Human Visual System,” in Proc. Fifth Int. Symp. Signal Processing and its applications, ISSPA ’99, Brisbane, Australia, pp. 313−316, Aug. 1999.
[57] J. Johnston, N. Jayant and R. Safranek, “Signal Compression Based on Models of Human Perception,” in Proc. IEEE, pp. 1325−1422, Oct. 1993.
[58] M. S. Kankanhalli and K. R. Ramakrishnan, “Content Based Watermarking of Images,” in Proc. of the 6th ACM International Multimedia Conference, Bristol, UK, pp. 61−70, Sep. 1998.
[59] E. Izquierdo, “Using Invariant Image Feature for Synchronization in Spread Spectrum Image Watermarking,” Journal on Applied Signal Processing, pp.
410−417, 2002.
[60] C. H. Chou and Y. C. Li, “A Perceptually Tuned Subband Image Coder Based on the Measure of Just-Noticeable-Distortion Profile,” IEEE Trans. Fuzzy Syst., vol.
3, no. 3, pp.467−476, Dec. 1995.
[61] A. P. Bradley, “A Wavelet Visible Difference Predictor,” IEEE Trans. Image Processing, vol. 8, no. 5, May 1999.
[62] J. Malo et al., “Perceptual Feedback in Multigrid Motion Estimation Using an Improved DCT Quantization,” IEEE Trans. Image Processing, vol. 10, no. 10, Oct. 2001.
[63] http://www.dmmd.net/research/imgprocessing/saltpepper_denoissing.htm
[64] E. S. Hore, B. Qiu and H. R. Wu, “Adaptive Noise Detection for Image Restoration with a Multiple Window Configuration,” in Proc. IEEE Int. Conf. on Image Processing, vol. 1, pp. 329−334, Sep. 2002.
[65] D. D. Muresan and T. W. Parks, “Adaptive Principal Components and Image Denoising,” in Proc. IEEE Int. Conf. on Image Processing, vol. 1, pp. 14−17, Sep. 2003.
[66] K. Arakawa, “A Nonlinear Digital Filter Using Fuzzy Clustering,” in Proc. IEEE Int. Conf. on Acoust., Speech, and Signal Processing, pp. IV309−IV312, Mar.
1992.
[67] K. Arakawa, “Fuzzy Rule-Based Signal Processing and its Application to Image Restoration,” IEEE J. Select. Areas Commun., vol. 12, no. 9, pp. 1495−1502,
Dec. 1994.
[68] B. Widrow and M. A. Lehr. “30 Years of Adaptive Neural Networks: Perceptron, Madaline, and Backpropagation.” in Proc. IEEE, vol. 78, pp. 1415−1442, Sep.
1990.
[69] H. L. Van Trees, Detection Estimation, and Modulation Theory, New York:
Wiley, 1968.
[70] X. Li and M. T. Orchard, “Edge-Directed Projection for Lossless Compression of Natural Images,” IEEE Trans. Image Processing, vol. 10, no. 6, pp. 813−817, June 2001.
[71] J. S. Lee, “Refined Filtering of Image Noise Using Local Statistics,” Comput.
Graphics Image Proc., vol. 15, pp. 380−389, 1981.
[72] J. Y. Chang and J. L. Chen, “Classifier-augmented median filters for image restoration,” IEEE Trans. Instrum. Meas., vol. 53, pp. 1415−1442, Apr. 2004.
List of Publication
著作目錄
姓名: 盧世茂 (Shih-Mao Lu)
已刊登或被接受之期刊論文：(總共 5.6 點)
[1] J. Y. Chang, S. M. Lu, “Image Blocking Artifact Suppression by the Modified Fuzzy Rule Based Filter,” International Journal of Fuzzy System, Vol. 6, No. 2, pp. 81−89, June 2004. (2點)
[2] S. M. Lu, S. F. Liang, and C. T. Lin, “A HVS-Directed Neural-Network-Based Approach for Salt-Pepper Impulse Noise Removal,” Journal of Information Science and Engineering, Vol. 22, No. 4, pp. 925−939, July 2006. (1.4點)
[3] J. Y. Chang, C. W. Cho, and S. M. Lu, “A Fuzzy Integral Based Information Fusion for Drowsiness Detection,” International Journal of Fuzzy System, Vol. 7, No. 2, pp. 63−71, June 2005. (1點)
[4] C. T. Lin, H. C. Pu, K. W. Fan, S. M. Lu and S. F. Liang, “A HVS-Directed Neural-Network-Based Image Resolution Enhancement Scheme for Image Resizing,” IEEE Trans. Fuzzy Syst. (Accepted on Jun. 2006) (1.2點)
研討會論文：
[1] J. Y. Chang, S. M. Lu, C. T. Lin, “A Two-Stage Fuzzy Filtering Method to Restore Images Contaminated by Mixed Impulse and Gaussian Noise,” Proc.
2002 Tenth National Conference on Fuzzy Theory and Its Applications.
[2] J. Y. Chang, S. M. Lu, “Image Blocking Artifact Suppression by the Modified Fuzzy Rule Based Filter,” Proc. IEEE Int. Conf. on Syst. Man, and Cybern., Vol.
1, pp. 486−491, Oct. 5-8, 2003.
[3] S. M. Lu, H. C. Pu, and C. T. Lin, “A HVS-Directed Neural-Network-Based Approach for Impulse-Noise Removal from Highly Corrupted Images,” Proc.
IEEE Int. Conf. on Syst. Man, and Cybern. , Vol. 1, pp. 72−77, Oct. 5-8, 2003.
[4] J. Y. Chang, C. W. Cho, and S. M. Lu, “A Fuzzy Integral Based Information Fusion for Drowsiness Detection,” Proc. Int. Conf. on Neural Information Processing, Oct 30 - Nov 2, 2005.
[5] J. Y. Chang, and S. M. Lu, “A Two-Stage Fuzzy Filtering Method to Restore Images Contaminated by Mixed Impulse and Gaussian Noises,” Proc. Int. Conf.
on Artificial Intelligence and Soft Computing, Zakopane, Poland, June 25-29, 2006. (Lecture Note in Artificial Intelligence)
Vita
博士候選人學經歷資料
姓名: 盧世茂 性別: 男
生日: 中華民國 65 年 7 月 9 日 籍貫: 台灣省台南縣
論文題目: 中文：基於人類視覺系統之混合雜訊消除技術
英 文 ： Human-Visual-System-Based Mixed-Noise Removal
Techniques
學歷:
1. 民國 87 年 6 月 國立清華大學動力機械工程系畢業。
2. 民國 89 年 6 月 國立交通大學電機及控制工程研究所畢業。
3. 民國 89 年 9 月 國立交通大學電機及控制工程研究所博士班。
經歷:
1. 民國 93 年至民國 94 年 大華技術學院兼任講師。