研究综述

基于深度学习的自然语言处理技术的发展及其在农业领域的应用

展开
  • 1. 中国农业科学院农业信息研究所,北京 100081
    2. 农业农村部农业大数据重点实验室,北京 100081
崔运鹏,男,博士,研究方向:农业知识管理、自然语言处理、农业大数据分析

收稿日期: 2018-09-20

  网络出版日期: 2019-04-04

The development of deep learning based Natural Language Processing (NLP) technology and applications in agriculture

Expand
  • 1. Institute of Agricultural Information, China Academy of Agricultural Sciences, Beijing, 100081
    2. Key Laboratory of Agricultural Big Data, Ministry of Agriculture and Rural Affairs, Beijing, 100081

Received date: 2018-09-20

  Online published: 2019-04-04

摘要

深度学习是本世纪出现的新一代机器学习技术,深度学习技术的发展与应用对现代自然语言处理技术产生了深远的影响。本文讨论了自然语言处理技术在深度学习技术的推动下所取得的主要进展,以及近几年自然语言处理领域出现的新的技术产品和经典案例,特别分析并阐述了深度学习在文本词向量构建、磁性标注与命名实体识别相结合用于词义消歧、卷及神经网络文本自动分类、主题提取及文本内容相关性计算等关键自然语言处理任务中所发挥的重要作用,并介绍了词向量技术在水稻知识领域的作用、农业领域专有命名实体识别以及农业文献内容相关性计算等实际应用案例,并剖析了了相关技术实现细节。最后本文展望了今后一个时期自然语言处理技术的发展方向,以及其在农业领域的应用前景,并阐明了自然语言处理技术对农业领域智能化应用不可或缺的意义。

本文引用格式

崔运鹏, 王健, 刘娟 . 基于深度学习的自然语言处理技术的发展及其在农业领域的应用[J]. 农业大数据学报, 2019 , 1(1) : 38 -44 . DOI: 10.19788/j.issn.2096-6369.190104

Abstract

Deep learning is an emerging but rapidly advancing technology having a profound impact on modern natural language processing (NLP) technology. This paper discusses recent developments of NLP technology driven by deep neural networks (DNN), as well as new products and recent cases. In particular, the paper examines advances relevant to the agriculture domain, such as DNN-based word embedding vector construction, the computational ability to recognize and name domain-specific entities and agricultural literature terms. Additionally, it analyzes the implementation details of related technologies. Finally, the paper reviews the trends and outlook for NLP technology, highlighting the significance of NLP technology for intelligent applications in agriculture.

参考文献

[1] 周翔. 微软副院长周明:NLP目前存在的问题、以及未来的发展方向[EB/OL]. ( 2017 -06-05)[2018-08-04].
[2] 微软亚洲研究院. 沈向洋:懂语言者得天下[EB/OL]. ( 2017 -11-03)[2018-08-04].
[3] 储节旺 . 知识管理概论[M]. 北京: 北京交通大学出版社. 2006: 283.
[4] AI正在农业领域崛起,它真能帮助养活整个世界吗? [EB/OL]. .
[5] 杨晓凡. 会打电话的 AI 背后:谷歌 Duplex 技术解析[EB/OL]. ( 2018 -05-11) [2018-08-04].
[6] 早优夫斯基 . 人机辩论赛,IBM 的 AI 战胜人类冠军背后我们该知道些什么?[EB/OL]. ( 2018- 09- 10) [2018-09-12]. .
[7] 维基百科,Word2vec[EB/OL].
[8] 数据挖掘机养成记 . 秒懂词向量Word2vec的本质[EB/OL].https://zhuanlan.zhihu.com/p/26306795.
[9] Quoc Le, Tomas Mikolov . Proceedings of the 31st International Conference on Machine Learning[J]. PMLR, 2014,32(2):1188-1196.
[10] Andrew Trask, Phil Michalak , John Liu. Sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddings. arXiv: 151106388 .[cs.CL].
[11] Covington P, Adams J, Sargin E. Deep neural networks for youtube recommendations [C]//Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 2016: 191-198.
[12] Yoon Kim. . Convolutional Neural Networks for Sentence Classification. arXiv:1408.5882 [cs.CL].
[13] Lei Zhang, Shuai Wang , SBing Liu . Deep Learning for Sentiment Analysis : A Survey. arXiv:1801.07883 [csCL].
[14] Sievert C, Shirley K E . LDAvis: A method for visualizing and interpreting topics [C]// Workshop on Interactive Language Learning, Visualization, and Interfaces at the Association for Computational Linguistics. 2014.
[15]
文章导航

/