数据应用

农业科学数据在线分析引擎设计与应用

  • 李佳乐 ,
  • 贺子康 ,
  • 姚琼 ,
  • 赵晓燕 ,
  • 周国民 ,
  • 张建华
展开
  • 1.中国农业科学院农业信息研究所北京 100081
    2.中国农业科学院国家南繁研究院海南三亚 572024
    3.农业农村部南京农业机械化研究所南京 210014
    4.国家农业科学数据中心北京 100081
    5.中国农业科学院西部农业研究中心新疆昌吉 831100
李佳乐,E-mail:2532211923@qq.com
贺子康,E-mail:hezikang@caas.cn
周国民;E-mail:zhouguomin@caas.cn
张建华,E-mail:zhangjianhua@caas.cn

收稿日期: 2025-09-04

  修回日期: 2025-10-22

  网络出版日期: 2025-12-26

基金资助

国家重点研发计划(2022YFF0711800);海南省自然科学基金(325MS155);三亚崖州湾科技城科技专项资助(SCKJ- JYRC-2023-45);中国农业科学院国家南繁研究院南繁专项(YBXM2448);中国农业科学院国家南繁研究院南繁专项(YBXM2340);中国农业科学院国家南繁研究院南繁专项(YBXM2409);中国农业科学院国家南繁研究院南繁专项(YBXM2410);中国农业科学院国家南繁研究院南繁专项(YBXM2430);中国农业科学院国家南繁研究院南繁专项(YBXM2508);中国农业科学院国家南繁研究院南繁专项(YBXM2509);中国农业科学院农业信息研究所/国家农业科学数据中心项目(NASDC2025XM11);中央级公益性科研院所基本科研业务费专项(JBYW-AIl-2025-05);中央级公益性科研院所基本科研业务费专项(Y2025YC90)

Design and Application of Online Analysis Engine of Agricultural Science Data

  • LI JiaLe ,
  • HE ZiKang ,
  • YAO Qiong ,
  • ZHAO XiaoYan ,
  • ZHOU GuoMin ,
  • ZHANG JianHua
Expand
  • 1. Agricultural Information Institute of CAAS, Beijing 100081, China
    2. National Nanfan Research Institute (Sanya), Chinese Academy of Agricultural Sciences, Sanya 572024, China
    3. Nanjing Research Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing 210014, China
    4. National Agriculture Science Data Center, Beijing 10081, China
    5. Western research institute, CAAS, Changji 831100, China

Received date: 2025-09-04

  Revised date: 2025-10-22

  Online published: 2025-12-26

摘要

针对农业大数据时代数据富集、知识转化难、现有工具数据壁垒高、语义缺失、灵活性不足的问题,本研究设计并开发了农业科学数据在线分析引擎。该引擎采用分层架构,包含用户交互层、智能工作流引擎、知识库与状态管理模块、容器化执行层,核心创新在于:构建数据状态描述符与算子能力画像的元数据驱动机制,提出SC-MPARank混合推荐模型,设计领域语义导向的动态可进化流水线。引擎通过知识图谱实现“持续学习-实时推理”,兼具通用平台灵活性、专家系统专业性与AutoML自动化能力,可智能组织执行现有算法。现已实际应用于育种、耕地、农业绿色发展三大场景,有效降低技术门槛,提升数据到决策的转化效率与可靠性,为智慧农业提供了实用的农业科学数据分析工具。

本文引用格式

李佳乐 , 贺子康 , 姚琼 , 赵晓燕 , 周国民 , 张建华 . 农业科学数据在线分析引擎设计与应用[J]. 农业大数据学报, 2025 , 7(4) : 458 -467 . DOI: 10.19788/j.issn.2096-6369.000131

Abstract

Aiming at the problems of data enrichment, difficult knowledge transformation, high data barriers of existing tools, missing semantics, and insufficient flexibility in the era of agricultural big data, this study designs and develops an online analysis engine for agricultural scientific data. The engine adopts a layered architecture, including a user interaction layer, an intelligent workflow engine, a knowledge base and state management module, and a containerized execution layer. The core innovations of the engine: constructing a metadata-driven mechanism with data state descriptors and operator capability images, proposing a hybrid recommendation model of SC-MPARank, and designing a dynamic and evolvable pipeline with a domain semantics orientation. The engine achieves ‘continuous learning - real-time inference’ through knowledge graph, combining the flexibility of a general platform, the expertise of an expert system and the automation capability of AutoML, and can intelligently organize the execution of existing algorithms. The engine has been practically applied to three major scenarios of breeding, cultivation, and agricultural green development, effectively reducing the technical threshold, improving the efficiency and reliability of data-to-decision transformation, and providing a practical agricultural scientific data analysis tool for smart agriculture.

参考文献

[1] RABHIL , FALIHN , AFRAITESA , et al. Big data approach and its applications in various fields. Procedia Computer Science, 2019, 155: 599-605.
[2] 农业大数据研究进展(2024). 农业大数据学报, 2024, 6(4):433-471.
  Progress of agricultural big data research (2024). Journal of Agricultural Big Data, 2024, 6(4):433-471.
[3] 温孚江. 农业大数据研究的战略意义与协同机制. 高等农业教育, 2013(11):3-6.
  Wen F J. The strategic significance and collaborative mechanism of agricultural big data research. Higher Agricultural Education, 2013(11): 3-6.
[4] 王传歧. 大数据技术在农业经济管理中的应用分析. 农业科技与装备, 2024(6):81-82.
  WANG C Q. Analysis of the application of big data technology in agricultural economic management. Agricultural Science&Technology and Equipment, 2024(6):81-82.
[5] 农宁勇. 大数据分析与挖掘在农业全产业链的价值实践. 科技资讯, 2024, 22(7):171-174.
  NONG N Y. Value and practice of big data analysis and mining in the whole agricultural industry. Science & Technology Information, 2024, 22(7):171-174.
[6] 许爱玲. 智能农业中农业大数据分析的应用、挑战与策略. 数字农业与智能农机, 2024(5):98-101.
  XU A L. Applications, challenges, and strategies of agricultural big data analysis in smart agriculture. Digital Agriculture and Smart Farming Machinery, 2024(5):98-101.
[7] 文燕. 基于Hadoop农业大数据管理平台的设计. 计算机系统应用, 2017, 26(5):74-79.
  WEN Y. Design of the management platform for agriculture big data based on Hadoop. Computer System Applications, 2017, 26(5):74-79.
[8] 孙亮. 基于云计算的云数据挖掘引擎研究. 山东农业工程学院学报, 2018, 35(12):27-28.
  SUN L. Research on cloud data mining engine based on cloud computing. The Journal of Shandong Agriculture and Engineering University, 2018, 35(12):27-28.
[9] 沈伟豪, 钟燕飞, 王俊珏, 等. 多模态数据的洪涝灾害知识图谱构建与应用. 武汉大学学报(信息科学版), 2023, 48(12): 2009-2018.
  SHEN W H, ZHONG Y F, WANG J J, et al. Construction and application of flood disaster knowledge graph based on multi-modal data. Geomatics and Information Science of Wuhan University, 2023, 48(12): 2009-2018.
[10] WANG N, LI S D, XIAO J X, et al. A collaborative scheduling and planning method for multiple machines in harvesting and transportation operations-Part Ⅰ: Harvester task allocation and sequence optimization. Computers and Electronics in Agriculture, 2025, 232: ID 110060.
[11] 王小燕, 张丽敏. 基于大数据的数据挖掘引擎研究. 电子设计工程, 2017, 25(15):31-34+38.
  WANG X Y, ZHANG L M. Research on data mining engine based on big data. Electronic Design Engineering, 2017, 25(15):31-34+38.
[12] 余永红, 向晓军, 高阳, 等. 面向服务的云数据挖掘引擎的研究. 计算机科学与探索, 2012, 6(1):46-57.
  YU Y H, XIANG X J, GAO Y, et al. Research on service-oriented data mining engine based on cloud computing. Journal of Frontiers of Computer Science and Technology, 2012, 6(1):46-57.
[13] 韩沙, 马德新. 农业大数据应用研究进展分析. 湖北农业科学, 2021, 60(2):15-19.
  HAN S, MA D X. Analysis on the progress of agricultural big data application research. Hubei Agricultural Sciences, 2021, 60(2):15-19.
[14] 韩楠. 促进农业大数据在现代农业应用的途径分析. 农业经济, 2017(8):25-27.
  HAN N. Analysis of approaches to promote the application of agricultural big data in modern agriculture. Agriculture Economy, 2017(8):25-27.
[15] Taylor J, Fruzangohar M, Walter J. Roseworthy 2014 Field trial phenotype data and matching 17K+ genotype data. The University of Adelaide. Dataset. 2023. https://doi.org/10.25909/23949333.v1.
文章导航

/