云农场智慧服务大数据平台设计与实现

doi:10.19788/j.issn.2096-6369.210402

摘要/Abstract

摘要：

随着现代信息技术在农业领域的广泛应用，海量农业数据得以收集、分析用于促进农业现代化发展。本文以大别山区连片特色农产品生产经营全产业链为研究背景，在系统分析该区域农产品生产加工销售等各产业链环节数据特征、有机整合农产品生产经营数据资源等需求的基础上，采用包含基础设施层、数据资源层、数据处理分析层、数据显示层等四层大数据平台总体架构的设计模式，搭建了基于Hadoop大数据技术的农产品全产业链数据资源库与大别山区云农场智慧服务大数据平台，面向产业区相关农业从业人员所需业务主题进行平台功能的开发，对农业数据资源库中数据实施数据清洗、数据挖掘、数据建模等技术处理，寻找农产品生产经营过程动态变化规律，实现了信息共享、智能预警与辅助决策等智慧服务功能。其中，信息共享功能用于提供大数据平台各子系统平台数据资源共享服务；智能预警功能用于提供农产品全产业链生产经营过程中农产品生产环境、价格等关键指标信息的预警服务；辅助决策功能用于提供农业从业者产业区农产品生产经营情况变化通知，辅助经营过程决策服务等。研发的云农场智慧服务大数据信息管理中心和数据可视化系统，可为促进大别山区特色农产品全产业链信息化与智能化水平提供参考。

关键词: 云农场, Hadoop, 智慧服务, 大数据平台

Abstract:

With the wide use of modern information technology in the field of agriculture, a massive amount of agricultural data can now be collected and analyzed to promote the development of agricultural modernization. This paper considers the existing research of the whole industry chain of production and management of the special agricultural products of the Dabie Mountain region. Systematical analysis was conducted to determine the characteristics of the data of various industry value chains, such as the production, processing, and marketing of agricultural products in this region. Moreover, the data resources of agricultural production and management were effectively integrated. Subsequently, the design pattern of a big data platform architecture, which includes four layers, an infrastructure layer, a data resource layer, a data processing and analysis layer, and a data display layer, was adopted. The data resource database was built for the whole industry chain of Dabie Mountain agricultural products. This database was based on the Hadoop big data framework and a big data platform for the smart services of a cloud server farm. Specifically, the platform’s functions were developed for the business tasks required by the relevant agricultural employees in the industrial area. The data in the developed database were successively processed by data cleaning, data mining, and data modeling to explore the regular dynamic changes in agricultural product production and management. Smart service functions such as information sharing, smart early warnings, and auxiliary decision-making were realized. In particular, the information sharing function offers data resource sharing services for each subsystem of the big data platform; the smart early warning function provides early warning services for production environment, price, and other key indices of agricultural products during the production and operation of the overall agricultural product industry value chain; the auxiliary decision-making function notifies agricultural practitioners of changes in the production and operation of agricultural products within the industry’s region and provides services such as auxiliary business decision-making services. The research and development of the cloud-based smart service big-data management center and data visualization system will be a useful reference for promoting the development of information and intelligence of the whole industry chain of special agricultural products in the Dabie Mountain region.

Key words: cloud farm, Hadoop, smart service, big data platform

中图分类号:

TP311.1

凌诺娟, 饶元. 云农场智慧服务大数据平台设计与实现[J]. 农业大数据学报, 2021, 3(4): 10-19.

Nuojuan Ling, Yuan Rao. Design and Implementation of a Big Data Platform for Cloud Server Farm Smart Services[J]. Journal of Agricultural Big Data, 2021, 3(4): 10-19.

图/表 8

表1

表2

图1

图2

图3

图4

图5

图6

参考文献 18

1	张凌栩, 韩锐, 李文明,等. 大数据深度学习系统研究进展与典型农业应用[J]. 农业大数据学报, 2019, 1(2):88-104.
	Zhang L X, Han R, Li W M, et al. A Survey of Big Data Deep Learning System and Typical Agricultural Application [J]. Journal of Agriculture Big Data,2019,1(2):88-104.
2	黄烽. 大数据技术在现代农业中的应用[J]. 河北农机, 2021 (06): 38-39.
	Huang F. Application of Big Data Technology in Modern Agriculture[J]. Hebei Agricultural Machinery, 2021 (06): 38-39.
3	柳平增, 王雪, 宋成宝,等. 基于大数据的西藏荒漠化治理植物优选与验证[J]. 农业工程学报, 36(10):166-173.
	Liu P Z, Wang X, Song C B, et al. Optimal Selection and Verification of Plant Species for Desertification Control in Tibet Based on Big Data[J]. Transactions of the Chinese Society of Agricultural Engineering, 36(10):166-173.
4	苑严伟, 冀福华, 赵博,等. 基于Solr的农田数据索引方法与大数据平台构建[J]. 农业机械学报, 2019, 050(011):186-192.
	Yuan Y W, Ji F H, Zhao B, et al. Farmland Data Indexing Method Based on Solr and Construction of Big Data Platform [J]. Journal of Agricultural Machinery, 2019, 050(011):186-192.
5	段青玲, 刘怡然, 张璐,等. 水产养殖大数据技术研究进展与发展趋势分析[J]. 农业机械学报, 2018, v.49(06):8-23.
	Duan Q L, Liu Y R, Zhang L, et al. Analysis of Research Progress and Development Trend of Big Data Technology in Aquaculture[J]. Journal of Agricultural Machinery,2018,v.49(06):8-23.
6	Lamrhari. A profile-based Big data architecture for agricultural context[C]. International Conference on Electrical and Information Technologies,2016,(10):26-27.
7	温孚江. 农业大数据研究的战略意义与协同机制[J]. 高等农业教育, 2013, 000(011):3-6.
	Wen F J. Strategic Significance and Synergy Mechanism of Agricultural Big Data Research [J].Higher Agricultural Edu-cation, 2013(11):3-6.
8	周国民. 我国农业大数据应用进展综述[J]. 农业大数据学报,2019,1(1): 16-23.
	Zhou G M. Progress in the Application of Big Data in Agriculture in China[J].Journal of Agricultural Big Data,2019,1(1):16-23.
9	孙海龙. 农业大数据专家孙九林院士: 数据信息改造传统农业[J]. 农业工程技术, 2016, 36(15):35-37.
	Sun H L. Agricultural Big Data Expert Sun Jiulin: Data Information Reforming Traditional Agriculture[J].Agricultural Engineering Technology, 2016, 36(15):35-37.
10	许世卫, 王东杰, 李哲敏. 大数据推动农业现代化应用研究[J]. 中国农业科学, 2015, 48(17):3429-3438.
	Xu S W, Wang D J, Li Z M. Applied Research on Big Data Promoting Agricultural Modernization [J]. China Agricultural Sciences, 2015, 48(17): 3429-3438.
11	Carolan M. Publicising food: big data, precision agriculture, and co‐experimental techniques of addition[J]. Sociologia Ruralis, 2017, 57(2): 135-154.
12	Coble K H, Mishra A K, Ferrell S, et al. Big data in agriculture: A challenge for the future[J]. Applied Economic Perspectives and Policy, 2018, 40(1): 79-96.
13	朱亮, 孟宪学, 赵瑞雪,等. 国家农业科学数据共享中心资源建设探析[J]. 数字图书馆论坛,2017,000(011):15-20.
	Zhu L, Meng X X, Zhao R X, et al. Resource Construction of National Agricultural Science Data Sharing Center [J]. Digital Library Forum, 2017, 000 (011): 15-20.
14	许世卫. 中国农业监测预警的研究进展与展望[J]. 农学学报,2018,008(001): 205-210.
	Xu S W. Research Progress and Prospect of Agricultural Monitoring and Early Warning in China [J]. Journal of Agriculture, 2018, 008(001): 205-210.
15	张萌, 董伟, 钱蓉,等. 安徽省植保大数据平台建设与应用展望[J]. 农业大数据学报, 2020, 2(1): 36-44.
	Zhang M, Dong W, Qian R, et al. Construction and Application Prospects of Big Data Platform for Plant Protection in Anhui Province[J]. Journal of Agricultural Big Data, 2020, 2(1): 36-44.
16	陈丽, 王启现, 刘娟,等. 农业科研试验基地数据管理标准体系构建[J]. 农业工程学报, 2020, 36(04):201-209.
	Chen L, Wang Q X, Liu J, et al. Establishment of Data Management Standard System for Agricultural Scientific Research and Experiment Station[J]. Transactions of the Chinese Society of Agricultural Engineering, 2020, 36(4): 193-201.
17	董春岩, 牛明雷, 姚艳,等. 蔬菜全产业链大数据平台建设与应用研究——以大白菜为例[J]. 农业大数据学报, 2021, 3(1): 66-72.
	Dong C Y, Niu M L, Yan Yao, et al. Research on the Construction and Application of a Big Data Platform for the Whole Vegetable Industry Chain: The Case of Chinese Cabbage[J]. Journal of Agricultural Big Data, 2021, 3(1): 66-72.
18	魏希文, 缪丽娟, 江源,等. 基于分层分区法的中国历史耕地数据的网格化重建[J]. 地理学报, 2016, 71(7): 1144-1156.
	Wei X W, Miao L J, J Y, etc. Grid Reconstruction of Historical Cultivated Land Data in China Based on Hierarchical Zoning Method [J]. Journal of Geography, 2016, 71 (7): 1144-1156.

序号	功能需求	需求描述	建设内容
1	数据资源录入存储	针对大别山区农产品全产业链各环节数据资源的整体录入，根据数据录入方案配置，完成录入数据整合汇总等功能。同时，支持农业物联网等设备装配农产品生产经营过程的数据传输方式。	云农场智慧服务大数据录入系统
2	数据加工处理	将汇聚到平台中的数据资源进行抽取、降噪、计算和聚合。主要功能是对农产品数据资源的维护管理、数据集成整合、统计聚合以及数据的共享。	云农场智慧服务大数据信息集成共享平台
3	数据分析应用与可视化	通过整合农产品的数据资源，满足生产经营主体对多个业务领域的数据管理分析功能需要，实现数据结果的可视化展现。建立大数据分析模型分析农产品全产业链经营情况变化，并深度挖掘数据资源的潜在价值，从而寻找农产品生产经营过程动态变化规律。	云农场智慧服务大数据综合服务平台
4	数据服务	满足农业数据资源分析结果的集中展示，提供对大别山区农产品全产业链生产经营情况的综合查询、智能预警、决策支持、产业链分析报告等智慧服务。	云农场智慧服务大数据综合服务平台

数据主题	数据内容	数据来源	数据处理
天	遥感图像、气象数据、地理位置数据等	与气象、遥感等信息网站接口获取	采集、清洗、分类、聚合、分析、存储等
地	传感器测量数据、视频监控数据、生长图像等	由传感器等物联网设备采集
人	农产品全产业链各环节生产经营数据、生态图像数据、文本解释数据等	人工采集、人工录入
网	网络端历史图像及文本数据等	应用客户端反馈、网络服务端存储

[1]	张明旭, 张茹, 席琳图雅, 陈元, 毕雅琼, 张春红, 吴涛涛, 李旻辉. 内蒙古地区中药资源大数据的应用与展望[J]. 农业大数据学报, 2021, 3(2): 42-53.
[2]	顾君, 贾暑花, 曾庆鸿. 基于知识中台的农业单品全产业链大数据平台建设研究[J]. 农业大数据学报, 2021, 3(1): 25-32.
[3]	张萌, 董伟, 钱蓉, 杨前进, 张立平. 安徽省植保大数据平台建设与应用展望[J]. 农业大数据学报, 2020, 2(1): 36-44.
[4]	赵春江. 植物表型组学大数据及其研究进展[J]. 农业大数据学报, 2019, 1(2): 5-14.