本研究利用叢集分析的方法融入特徵萃取裡,以減低在高維度資料中存在著一些 同類別差異性、非常態或多峰混合分布以及共同平均值等這些情況使得辨識率下降的 問題,從數據上來看可以發現在PCA 中因為沒有考慮到組間分散度矩陣以及組內分散 度矩陣的問題,因此融入叢集分析的方法並無法獲得相當地改善。對於 LDA 以及 NWFE 兩種特徵萃取法,因為兩種方法都是要最佳化組間分散度矩陣及組內分散度矩 陣的比率,所以採用融入叢集分析的方法通常能獲得效能上的增加以及辨識率的提升。
單就特徵萃取的方法來比較,可由數據上明顯的看出只用NWFE 本身的辨識率已 經相當高了,即使是融入叢集分析之 LDA 所萃取過後的辨識率,也難以比單純使用 NWFE 萃取過後的辨識率高。
此外在本研究中所使用了k-mean 及 fuzzy c-mean 兩種叢集分析的方法,對於本研 究中的效能兩種叢集分析方法就數據上來看並無太大的差異。另外,在 fuzzy c-mean 的演算法中還有提供一些對於使用叢集分析的資訊量在本研究中並無使用到,因此希 望往後的研究能夠多加利用這些fuzzy c-mean 所提供的訊息。
高維度資料中同類別也許可以分成數個叢集,但是在本研究中採用每個類別固定 分成數個叢集。在未來的研究中期望能找到一個準則,希望能夠有一個機制能自動的 判斷該類別分成幾個叢集對整體分類的效果能夠達到最大的改善。
參考文獻
中文部分
郭伯臣、吳慧珉、楊晉民、柯立偉、白家豪(民92)。樣式辨識技術於學生補救教學 分組之應用-以國小數學領域「扇形」單元為例,九十二學年度師範學院教育學 術論文發表會,台南師院,10 月 24-25 日。
郭伯臣(民95)統計樣式辨認於測驗資料之應用。測驗統計年刊,第十三輯下期,
pp.146-170。
英文部分
Chen, G-S., Ko, L-W., Kuo, B-C., and Shih, S-C. (2004). A Two-stage Feature Extraction for Hyperspectral Image Data Classification. Proceedings of International Geoscience
and Remote Sensing Symposiums, Sep 20-24.
Cover, T. M. and Hart, P. E. (1967). Nearest Neighbor Pattern Classification. IEEE
Transactions on Information Theory, vol. 13, no. 1, pp.21-27.
Earl Gose, Richard Johnsonbaugh, and Steve Jost, "Pattern recognition and Image
Analysis", Prentice Hall Inc., New Jersey, 1996
Fisher, R. A. (1936). The use of multiple measures in taxonomic problems. Ann. Eugenics, vol. 7, pp. 179-188.
Fukunaga, K. (1990). Introduction to Statistical Pattern Recognition. San Diego, CA:Academic Press.
Hastie, T. and Tibshirani, R. (1996). Discriminant Adaptive Nearest Neighbor
Classification. IEEE Transcation on Pattern Analysis and Machine Intelligence. vol.
18, no. 6, pp. 607-616.
Hughes, G. F. (1968). On the mean accuracy of statistical pattern recognition. IEEE Trans.
Inform. Theory, vol. 14, pp. 55 - 63, Jan.
Hui-Chuan Lin, and J. S. Roger Jang, "Survey and Implementation of Clustering Algorithm", MS Thesis, Tsing Hua University, Taiwan, R.O.C., 1998.
J. -S. R. Jang, C. –T. Sun, and E. Mizutani, "Neural-Fuzzy and soft Computing", Chap 15, 1997
J. T. Tou, and R. C. Gonzalez, "Pattern Recognition Principles", Addison-Wesley Publishing Company, Inc. Published simultaneously In Canada, 1974
Jim C. Bezdek, "Fuzzy mathematics In pattern classfication", PhD thesis, Applied Math.
Center, Cornell University, Ithaca, 1973
Jolliffe, I. T. (1986). Principal Components Analysis. Springer-Verlag, New York.
Kuo B.-C. and Landgrebe D. A. (2002). A covariance estimator for small sample size classification problems and its application to feature extraction. IEEE Trans. Geosci.
Remote Sens., vol. 40, no. 4, pp. 814–819, Apr.
Kuo, B-C. and Landgrebe, D. A. (2004). Nonparametric Weighted Feature Extraction for Classification. IEEE Trans. on Geoscience and Remote Sensing, vol. 42, no. 5, pp.
1096-1105, May.
Kuo, B-C., Landgrebe, D.A., Ko, L-W., and Pai, C-H. (2003). Regularized Feature Extractions for Hyperspectral Data Classification. Proceedings of International
Geoscience and Remote Sensing Symposium, Toulouse. France, July.
Landgrebe, D. A. (2003). Signal Theory Methods in Multispectral Remote Sensing. John Wiley and Sons, Hoboken, NJ: Chichester.
MacQueen, "Some method for classification and analysis of multivariant observations", Process of the Fifth Berkeley Symposium on Mathematical Statistical and Probability.
University of California Press, 1967
S.T, and K.K., "Pattern Recognition", Chap2, Academic Press, 1999
Shah, C. A., Watanachaturaporn, P., Arora, M. K., and Varshney, P. K. (2003). Some
Recent Results on Hyperspectral Image Classification. In IEEE Workshop on Advances
in Techniques for Analysis of Remotely Sensed Data, NASA Goddard Spaceflight
center, Greenbelt, October 27-28.Tadjudin S. and Landgrebe D. A. (1998). Classification of High Dimensional data with
Limited Training Samples, Purdue University, West Lafayetee, IN., TR-EE 98-8,
April.Thomaz, C. E. and Gillies, D. F. (2004). A Maximum Uncertainty LDA-based approach for
Limited Sample Size problems - with application to Face Recognition. Technical
Report TR-2004-01, Department of Computing, Imperial College, London, UK, January.Yu, H. and Yang, J. (2001). A direct LDA algorithm for high dimensional data – with application to face recognition. Pattern Recognition, vol. 34, pp. 2067-2070.