• 沒有找到結果。

結論與未來發展

本篇論文中我們提出了一個新的方法來推薦濾鏡,我們應用三個深度學習 的網路抓取照片的資訊,再利用類神經網路來分析學習照片中的物件、場景與 美學屬性;完成濾鏡的推薦,並且都取得了比前一篇論文[7]在 Top-1 取得較好的 結果,我們也提出直接使用Instagram 上的照片與 Hashtag 作為訓練資料,避免了 先前的方法[7]需要花費大量時間與成本搜集資料集。從我們的實驗可以證明這 些資料 的可 用性 ,也 藉由這 些資 料取 得了 更好的 濾鏡 預測 結果 ,直接 使用 Instagram 的照片與 Hashtag 可以幫助在未來要進行更多種類濾鏡的推薦或是讓相 關的任務能快速的取得資料。

目前由於 Instagram 並沒有直接提供正式的介面或是方法能夠取得資料,只 有相關的單位才有機會使用使用到完整的Instagram 訓練資料(跟照片所有相關的 屬性),而我們取得的資料量只佔Instagram 上的照片中很小的ㄧ部分,如果在未 來能夠使用真正完整且大量的訓練資料或是取得 Instagram 濾鏡的程式與做法,

相信這個任務會有更大的挑戰性以及達到更好的結果。

另外目前偵測一張照片適合的照片需要花費大約一秒的時間,在未來我們 希望能提升偵測的速度,藉由找出更能夠幫助判斷濾鏡的照片資訊或是整體的 網路架構來改善,藉此來提升我們偵測的速度。

30

參考文獻

1. Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun. Deep Residual Learn-ing for Image Recognition. arXiv:1512.03385, 2015.

2. Tsung-Yi Lin, Piotr Dollár, Ross Girshick, Kaiming He, Bharath Hariharan, Serge Belongie. Feature Pyramid Networks for Object Detection.

arXiv:1612.03144, 2016.

3. Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick. Mask R-CNN arXiv:1703.06870, 2017

4. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning Deep Features for Scene Recognition using Places Database. NIPS, 2014.

5. Tsung-Yi Lin, Michael Maire, Serge Belongie, Lubomir Bourdev, Ross Girshick, James Hays, Pietro Perona, Deva Ramanan, C. Lawrence Zitnick, Piotr Dollár. Microsoft COCO: Common Objects in Context. ECCV, 2014.

6. R. Girshick. Fast R-CNN. ICCV, 2015.

7. Wei-Tse Sun, Ting-Hsuan Chao, Yin-Hsi Kuo, Winston H. Hsu. Photo Filter Recommendation by Category-Aware Aesthetic Learning. arXiv:1608.05339, 2016.

8. S. Bakhshi, D. A. Shamma, L. Kennedy, and E. Gilbert. Why We Filter Our Photos and How It Impacts Engagement. AAAI, 2015.

9. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Pro-cessing Systems, 2012, pp. 1097–1105.

10. X. Lu, Z. Lin, H. Jin, J. Yang, and J. Z. Wang. Rapid. Rating pictorial aesthet-ics using deep learning. ACM, 2014, pp. 457–466.

11. Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun. Identity Mappings in Deep Residual Networks. ECCV, 2016.

12. Saining Xie, Ross Girshick, Piotr Dollár, Zhuowen Tu, Kaiming He. Aggre-gated Residual Transformations for Deep Neural Networks. CVPR, 2017.

13. Yuheng Hu, Lydia Manikonda, Subbarao Kambhampati. What We Insta-gram: A First Analysis of Instagram Photo Content and User Types.

AAAI,2015.

14. Dhruv Mahajan, Ross Girshick, Vignesh Ramanathan, Kaiming He, Mano-har Paluri, Yixuan Li, Ashwin BMano-harambe, Laurens van der Maaten. Explor-ing the Limits of Weakly Supervised PretrainExplor-ing. arXiv:1805.00932 2018.

15. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, Li Fei-Fei.

ImageNet: A large-scale hierarchical image database. CVPR, 2009.

16. Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton. ImageNet Classifica-tion with Deep ConvoluClassifica-tional Neural Networks. NIPS, 2012.

17. Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi. You Only Look Once: Unified, Real-Time Object Detection. CVPR, 2016.

18. Christian Szegedy,Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dra-gomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, Andrew Rabinovich.

Going Deeper with Convolutions. CVPR, 2014.

19. Naila Murray, Luca Marchesotti, Florent Perronnin. AVA: A large-scale da-tabase for aesthetic visual analysis. CVPR, 2012.

20. Hossein Talebi, Peyman Milanfar. NIMA: Neural Image Assessment.

arXiv:1709.05424 2017.

21. R. Datta, D. Joshi, J. Li, and J. Z. Wang. Studying aesthetics in photographic

32

images using a computational approach. ECCV, 2006.

22. Y. Luo and X. Tang. Photo and video quality evaluation: Focusing on the subject. ECCV, 2008.

23. Y. Ke, X. Tang, and F. Jing. The design of high-level features for photo quality assessment. CVPR, 2006.

24. Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, Alex Alem. Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning.

CVPR, 2016.

25. G.E. Nasr, E.A. Badr, C. Joun. Cross Entropy Error Function in Neural Net-works: Forecasting Gasoline Demand. AAAI, 2002.

26. Jian Ren, Xiaohui Shen, Zhe Lin, Radomír Mech, David J. Foran. Personal-ized Image Aesthetics. ICCV, 2017.

相關文件