第五章 結論與建議
5.2 建議
第五章 結論與建議
本章節將針對本研究方法做個結論並提出建議供有意想針對本研究繼續發 展的研究者參考。
5.1 結論
本研究利用了成對約束法及樣本間有群聚性的性質先用分群的方式先將所 有樣本分群,在少樣本情況下,還是可以得到未知類別樣本間的一些可用資訊來 進行訓練,所以在低維度下還是擁有不錯的正確率,再加上樣本多的時候也能使 辨識能力更加穩定,所以更加確信利用結合分群法與成對約束法在鄰接矩陣的設 計上可以獲致更佳正確率。
5.2 建議
首先在分群和決定邊界點的方法上,尚有其他方法,例如模糊cc-均值分群法 (fuzzy cc-means clustering)[43]和後驗機率(posterior probability)[5], [17], [18]可以 分別用來分群和判別是否為邊界點的方法。最後,本研究在目前主要針對在小樣 本資料集有不錯的辨識效果,希望往後可以進一步針對大樣本資料集,例如:人 臉圖、高光譜圖像、指紋辨識圖,期待有意研究的研究人員可以將本研究方法加 上前面建議加以修正改良運用在這些圖像上。
53
参考文獻
中文部分
[1] 周 志 成 , 拉 普 拉 斯 矩 陣 , 民 103 年 12 月 4 日 , 取 自 : https://ccjou.wordpress.com/2014/12/04/。
[2] 陳詩國、張道強,半監督降維方法的實驗比較,軟件學報,江蘇南京,
pp.28-43,2011。
[3] 白亞騰、劉衛東、汪敏、王雪松、程玉虎,基於成對約束的稀疏嵌入遙感 影像降維,中國科技論文在線,江蘇徐州,221116,2014。
英文部分
[4] G. F. Hughes, “On the mean accuracy of statistical pattern recognition,” IEEE Transactions on Information Theory, vol. 14, pp. 59-63, Jan. 1968.
[5] K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed., Academic Press, New York, 1990.
[6] S. J. Raudys and A. K. Jain, “Small sample size effects in statistical pattern recognition: recommendations for practitioners,” IEEE Transaction on Pattern Analysis and Machine Intelligence, vol.13 no.3, pp. 252-264, 1991.
[7] B. C. Kuo and D. A. Landgrebe, “Nonparametric weighted feature extraction for classification,” IEEE Transaction on Geoscience and Remote Sensing, vol.42, no.5, pp.1096-1105, 2004.
[8] R. Fisher, “The Use of Multiple Measures in Taxonomic Problems,” Annals of Eugenics, vol. 7, pp. 179-188, 1936.
[9] R. O. Duda, P. E. Hart, and D. G. Stock, Pattern Classification, 2nd ed. New York: Wiley, 2001.
[10] K. Fukunaga, and J. M. Mantock, “Nonparametric discriminant analysis,”
54
IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol.5, pp.
671-678, 1983.
[11] Y. Guo, T. Hastie, and R. Tibshirani, “Regularized linear discriminant analysis and its application in microarrays,” Biostatistics, Vol. 8, No. 1, pp. 86–100, 2007.
[12] P. Howland, M. Jeon, and H. Park, “Structure preserving dimension reduction for clustered text data based on the generalized singular value decomposition,”
SIAM J. Matrix Anal. Appl., Vol. 25, No. 1, pp. 165–179, 2003.
[13] B. C. Kuo, and D. A. Landgrebe, “Nonparametric weighted feature extraction for classification,” IEEE Transaction on Geoscience and Remote Sensing, Vol.42, No.5, pp.1096-1105, 2004.
[14] S. B. Serpico, and G. Moser, “Extraction of spectral channels from hyperspectral images for classification purposes,” IEEE Transactions on Geoscience and Remote Sensing, Vol. 45, No. 2, pp.484-495, Feb. 2007.
[15] J. M. Yang, and P. T. Yu, ”A novel nonparametric linear discriminant analysis for high-dimensional data classification,” 2009 International Conference on Advanced Information Technologies, Chaoyang University of Technology,
Taichung, Taiwan.
[16] J. M. Yang, P. T. Yu, B. C. Kuo, and T. Y. Hsieh, “A novel fuzzy linear feature extraction for hyperspectral image classification,” in Proc. of IEEE International Conference on Geoscience and Remote Sensing Symposium, pp.
3895 – 3898, 2006.
[17] V. N. Vapnik, Statistical Learning Theory, Wiley, New York, 1998.
[18] F. van der Heijden, R. P. W. Duin, D. de Ridder, and D. M. J. Tax, Classification, Parameter Estimation and State Estimation: An Engineering
55
Approach Using MATLAB, John Wiley & Sons, 2004.
[19] T. Fletcher, “Support vector machines explained,” [Online]. Available:
http://www.tristanfletcher.co.uk/SVM%20Explained.pdf, 2009.
[20] O. Chapelle, B. Scholkopf, and A. Zien, Semi-Supervised Learning, Cambridge, MA: MIT Press, 2006.
[21] T. Zhang, and R. K. Ando, “Analysis of spectral kernel design based semi-supervised learning,” in Proc. NIPS 18, MIT Press, Cambridge, MA, 2006, pp. 1601–1608.
[22] S. Basu, M. Bilenko, and R.Mooney, “A probabilistic framework for semi-supervised clustering,” KDD’04, ACM Press, 2004, pp.59-68.
[23] E. P. Xing, A. Y. Ng, M. I. Jordan and S. Russell,“Distance metric learning with application to clustering with side-information,” NIPS 15, MIT Press, Cambridge, MA, 2003, pp. 505-512.
[24] D. Klein, S. Kamvar, and C. Manning, “From instancelevel constraints to space-level constraints: making the most of prior knowledge in data clustering,”
Proc. of the 19th Int’l Conf. On Machine Learning, Morgan Kaufmann
Publishers, Sydney, 2002, pp. 307-314.
[25] S. Roweis, A. Bar-Hillel, T. Hertz, N. Shental, and D.Weinshall,“Learning a mahalanobis metric from equivalence constraints,” J. Mach. Learning Res., MIT Press, 2005, pp. 937-965.
[26] D. Zhang, Z. Zhou, and S. Chen, “Semi-Supervised Dimensionality Reduction,”
in Proc. 7th SIAM Int. Conf. Data Mining (SDM), Minneapolis, MN, Apr. 2007 pp.629-634.
[27] S. G. Chen, and D. Q. Zhang, “Semisupervised Dimensionality Reduction With Pairwise Constraints for Hyperspectral Image Classification,” IEEE
56
Geosci. Remote Sens. Lett, vol. 8, no. 2, pp. 369-373, March 2011.
[28] Y. Zhou, J. Peng, and C.L.P. Chen, “Dimension Reduction Using Spatial and Spectral Regularized Local Discriminant Embedding for Hyperspectral Image Classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 2, pp. 1082-1095, Feb. 2015.
[29] W. Li, Q. Du, F. Zhang, and W. Hu, “Collaborative-Representation-Based Nearest Neighbor Classifier for Hyperspectral Imagery,” IEEE Geoscience and Remote Sensing Letters, vol. 12, no. 2, pp. 389-393, Feb. 2015.
[30] M. Cui, and S. Prasad, “Class-Dependent Sparse Representation Classifier for Robust Hyperspectral Image Classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 5, pp. 2683-2695, 2015.
[31] P. Langley, W. Iba, and K. Thomas, “An analysis of bayesian classifiers,” in Proc.10th Nat. Conf. Artificial Intelligence, San Jose, CA, 1992, pp. 223-228.
[32] G. Anthony, H. Gregg, and M. Tshilidzi, “Image Classification Using SVMs:
One-against-One Vs One-against-All,” in 28th Asian Conference on Remote Sensing, 2007.
[33] L. Saul, “Nonlinear Dimensionality Reduction by Locally Linear Embedding,”
Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
[34] M. Belkin and P. Niyogi, “Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering,” Advances in Neural Information Processing Systems 14, Vancouver, British Columbia, Canada, 2001.
[35] X. He and P. Niyogi, “Locality Preserving Projections,” Advances in Neural Information Processing Systems 16, Vancouver, British Columbia, Canada, 2003.
[36] V. Franc and V. Hlavac, “Statistical Pattern Recognition Toolbox for Matlab,”
57
[Online]. Available: http://cmp.felk.cvut.cz/cmp/software/stprtool/, 2004.
[37] L. Qiao, S. Chen, and X. Tan, “Sparsity preserving projections with applications to face recognition,” Pattern Recognit., vol. 43, no. 1, pp. 331-341, Jan. 2010.
[38] J. Wright, A. Yang, S. Sastry, and Y. Ma, “Robust face recognition via sparse representation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp.
210-227, Feb. 2009.
[39] J. M. Keller and D. J. Hunt, “Incorporating fuzzy membership functions into the perceptron algorithm,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 7, no. 6, pp. 693–699, 1985.
[40] J. M. Keller, M. R. Gray, and J. A. Givens, “A fuzzy k-nearest algorithm,”
IEEE Trans. Syst., Man, Cybern., vol. SMC-15, pp. 580–585, 1985.
[41] A. Asuncion, and D. Newman, “UCI Machine Learning Repository,” [Online].
Available: http://archive.ics.uci.edu/ml/index.html, 2007.
[42] R. P. W. Duin, C. Lai, E. Pekalska and D. M. J. Tax, ”Exercises with PRTools,”
[Online]. Available: http://www.cs.man.ac.uk/~pekalska/ASPR_exercises.pdf, 2009.
[43] J. Bezdek, R. Ehrlich, and W. Full, “FCM: The Fuzzy c-means Clustering Algorithm,” Comput. Geosci., vol. 10, no. 2-3, pp. 191-203, 1984.