本論文所採用的 LSTM 深度神經網路語言模型雖然比起其他摘要器具 有更好的摘要擷取效能,但深度神經網路語言模型架構包含了許多類型,
都能應用於摘要擷取問題,例如卷積神經網路(Convolutional Neural Network, CNN) (LeCun & Bengio 1995)。若未來能探討不同神經網路語言架構,更能 進一步了解何種架構在摘要擷取上,具有更好的擷取效益。
第陸章 參考文獻
曾士昌(2010)。以句子為基礎之文件摘要(未出版之碩士論文)。國立屏東 商業技術學院,屏東。
邱怡菁(2014)。以 LDA 為基之英文課程文字稿摘要法(未出版之碩士論 文)。國立屏東大學,屏東。
黃喬(2016)。以詞頻、詞頻-逆向句子頻率和詞頻-句子頻率結合 LDA 之 英語課程文字稿摘要法(未出版之碩士論文)。國立屏東大學,屏東。
Ackley, D., Hinton, G., & Sejnowski, T. (1985). A learning algorithm for boltzmann machines. Cognitive Science, 9(1), 147-169.
Al-Saleh, A. B., & Menai, M. E. B. (2017). Solving Multi-document Summarization as a Capacitated Profitable Tour Problem. Preprint submitted to Information Sciences.
Ayana. (2015). Single document summarization using word and sentence embeddings. Joint International Mechanical, Electronic and Information Technology Conference.
Bahdanau, D., Cho, K., & Bengio, Y. (2016). Neural machine translation by jointly learning to align and translate. International Conference on Learning Representations.
Bahdanau, D., Chorowski, J., Serdyuk, D., Brakel, P., & Bengio, Y. (2015).
End-to-end attention based large vocabulary speech recognition. In 2016 IEEE International Conference on Acoustics, Speech and Signal
Processing (ICASSP), 4945-4949.
Barzilay, R., & Elhadad, M. (1999). Using lexical chains for text summarization.
Advances in automatic text summarization, 111-121. Retrieved from http://www.aclweb.org/anthology/W97-0703
Bengio, Y. (2009). Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1), 1-127.
Bengio, Y., Ducharme, R., & Vincent, P. (2003). A neural probabilistic language model. Journal of Machine Learning Research, 3, 1137-1155.
Bengio, Y., Simard, P., & Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2), 157-166.
Boger, Z., & Guterman, H. (1997). Knowledge extraction from artificial neural network models. In: Proceedings of the IEEE International Conference on Systems Man and Cybernetics, SMC’97, Orlando, Florida, 3030-3035.
Cao, Z., Wei, F., Dong, L., Li, S., & Zhou, M. (2015). Ranking with recursive neural networks and its application to multi-document summarization. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial
Intelligence, 2153-2159. Retrieved from http://dl.acm.org/citation.cfm?id=2886620
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. NIPS Deep
Learning Workshop.
Elman, J. L. (1990). Finding Structure in Time. Cognitive Science, 14(2), 179-211.
Elman, J. L. (1991). Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7, 195-224.
Erkan, G., & Radev, D. R. (2004). Lexrank: Graph-based lexical centrality as salience in text summarization. J. Artif. Intell. Res.(JAIR), 22(1), 457-479.
Ghosh, S., Vinyals, O., Strope, B., Roy, S., Dean, T., & Heck, L. (2016).
Contextual lstm (clstm) models for large scale nlp tasks. In KDD Workshop on Large-scale Deep Learning for Data Mining (DL-KDD).
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J.
(2015). LSTM: A Search Space Odyssey. In ICML.
Hinton, G. E. (1986). Learning Distributed Representations of Concepts.
Proceedings of the Eighth Annual Conference of the Cognitive Science Society, 1-12. Retrieved from
http://www.cs.toronto.edu/~hinton/absps/families.pdf
Hinton, G. E., & Shallice, T. (1991). Lesioning an attractor network:
investigations of acquired dyslexia. Psychological review, 98(1), 74.
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735-1780.
Jones, K. S. (1972). A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation, 28(1), 11-20.
Jones, K. S. (1999). Automatic summarising: factors and directions. Advances in Automatic Text Summarization, 1-12. Retrieved from
https://www.cl.cam.ac.uk/archive/ksj21/ksjdigipapers/summbook99.pdf King, B., Jha, R., Johnson, T., & Sundararajan, V. (2011). Experiments in
Automatic Text Summarization Using Deep Neural Networks. Machine Learning.
Larsen, B., & Aone, C. (1999). Fast and effective text mining using linear-time document clustering. In Proc. of the Fifth ACM SIGKDD Int’l Conference on Knowledge Discovery and Data Mining, 16-22.
LeCun, Y., & Bengio, Y. (1995). Convolutional networks for images, speech, and time series. The Handbook of Brain Theory and Neural Networks, 255-258.
LeCun,Y., Simard, P. Y., & Pearlmutter, B. A. (2002). Automatic learning rate maximization by on–line estimation of the Hessian’s eigenvectors. In Proc.
Eur. Symp. Artificial Neural Netw (ESANN 2002), 156-163.
Leveling, J., Ganguly, D., Dandapat, S., & Jones, G. J.F. (2012). Approximate Sentence Retrieval for Scalable and Efficient Example-based Machine Translation. Proceedings of COLING 2012: Technical Papers, 1571-1586.
Lin, C. Y. (2004). Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out: Proceedings of the ACL-04 Workshop, 74-81.
Lin, C. Y., & Hovy, E. H. (2003). Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proceedings of 2003 Language Technology Conference (HLT-NAACL 2003), Edmonton, Canada, May.
Lin, R., Liu, S., Yang, M., Li, M., Zhou, M., & Li, S. (2015). Hierarchical recurrent neural network for document modeling. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 899-907.
Lin, S. H., & Chen, B. (2009). Improved Speech Summarization with
Multiple-hypothesis Representations and Kullback-Leibler Divergence Measures. Proceeding of the 10th Annual Conference of the International
Speech Communication Association (Interspeech), 1847-1850.
Liu, P., Qiu, X., & Huang, X. (2016). Recurrent neural network for text classification with multi-task learning. In Proceedings of International Joint Conference on Artificial Intelligence.
Mani, I. (2001). Recent developments in textsummarization. Proceedings of the 10th International Conference on Information and Knowledge
Management, 529-531.
Mani, I., & Maybury, M. T. (1999). Advances in Automatic Text Summarization. Cambridge: MIT Press.
Mas, J. F., & Flores, J. J. (2008). The application of artificial neural networks to the analysis of remotely sensed data. International Journal of Remote Sensing, 29, 617-663.
Masters, K. (2011). A brief guide to understanding MOOCs. The Internet Journal of Medical Education, 1(2).
Matsuo, Y., & Ishizuka, M. (2004). Keyword extraction from a single document using word co-occurrence statistical information. International Journal on Artificial Intelligence Tools, 13(01), 157-169.
Mihalcea, R., & Tarau, P. (2004). TextRank: bringing order into texts. In Proceedings of Conference on Empirical Methods in Natural Language
Processing, 404-411.
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013a). Efficient estimation of word representations in vector space. In Proceedings of International Conference on Learning Representations.
Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013b).
Distributed representations of words and phrases and their compositionality.
In Advances on Neural Information Processing Systems, 26, 3111-3119.
Mitra, M., Singhal, A., & Buckley, C. (1997). Automatic text summarization by paragraph extraction. In Proceedings of the ACL/EACL Workshop on Intelligent Scalable Text Summarization, 39-46.
Nallapati, R., Zhou, B., Santos, C. dos., Gulçehre, C., & Xiang, B. (2016).
Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond. Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning (CoNLL), 280-290.
Over, P., & Yen, J. (2003). An introduction to DUC-2003: intrinsic evaluation of generic news text summarization systems. In Proceedings of the DUC 2003 workshop on text summarization.
PadmaPriya, G., & Duraiswamy, K. (2014). An Approach for Text
Summarization Using Deep Learning Algorithm. Journal of Computer
Science, 10(1), 1-9.
Paice, C. D. (1990). Constructing Literature Abstracts by Computer Techniques and Prospects. Journal of Information Processing and Management, 26(1), 171-186.
Pal, A. R., & Saha, D. (2014). An approach to automatic text summarization using WordNet. In:Advance Computing Conference (IACC), 1169-1173.
Pennington, J., Socher, R., & Manning, C. D. (2014). Glove: Global Vectors for Word Representation. Proceedings of the Conference on the Empirical Methods in Natural Language Processing (EMNLP), 1532-1543.
Soutner, D., & Müller, L. (2014). Continuous Distributed Representations of Words as Input of LSTM Network Language Model. International Conference on Text, Speech, and Dialogue, 150-157.
Steinberger, J., & Jezek, K. (2012). Evaluation measures for text summarization.
Computing and Informatics, 25, 1001-1025.
Witbrock, M., & Mittal, V. (1999). Ultra Summarization: a Statistical Approach to Generating Highly Condensed Non-extractive Summaries. Proceedings of the 22th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 315-316.