农业大数据学报 ›› 2020, Vol. 2 ›› Issue (1): 3-10.doi: 10.19788/j.issn.2096-6369.200101

• 专刊——区域性农业大数据发展 •    下一篇

农民远程教育大数据分析平台设计与实现

孙素芬1,2(), 赵继春1,2(), 郭建鑫1,2, 乔珠峰1,2, 陈会娜1,2, 王敏1,2   

  1. 1. 北京市农林科学院农业信息与经济研究所,北京 100097
    2. 北京农村远程信息服务工程技术研究中心,北京 100097
  • 收稿日期:2019-12-10 出版日期:2020-03-26 发布日期:2020-06-02
  • 通讯作者: 赵继春 E-mail:sunsf@agri.ac.cn;zhaojc@agri.ac.cn
  • 作者简介:孙素芬,女,研究员,研究方向:农业信息技术;E-mail: sunsf@agri.ac.cn
  • 基金资助:
    北京市科技计划项目(Z191100007519010)

Design and Implementation of Big Data Analysis Platform for Farmers' Distance Learning

Sufen Sun1,2(), Jichun Zhao1,2(), Jianxin Guo1,2, Zhufeng Qiao1,2, Huina Chen1,2, Min Wang1,2   

  1. 1. Beijing Academy of Agriculture and Forestry Sciences of BAAFS, Institute, Beijing 100097,China
    2. The Research Center of Beijing Engineering Technology for Rural Remote Information Services, Beijing 100097,China
  • Received:2019-12-10 Online:2020-03-26 Published:2020-06-02
  • Contact: Jichun Zhao E-mail:sunsf@agri.ac.cn;zhaojc@agri.ac.cn

摘要:

开展农民现代远程教育是提升农村信息化水平、消除数字鸿沟的一项重要战略部署,农民远程教育大数据分析对进一步提升远程教育服务水平和服务能力具有重要意义。本文基于农民远程教育平台十余年积累的数据基础,通过数据采集和集成将用户学用数据和平台资源数据进行梳理、汇聚和规范化处理,建立起一套统一的数据管理系统。构建了远程教育数据统计分析、表示及综合评估模型库。应用Hadoop和Spark大数据分析技术实现了数据的HQL及其Spark SQL查询分析。通过软件工程技术及数据库开发技术实现了大数据可视化分析与管理系统,实现评估指标体系管理、课程组织评估、培训资源评估、教学管理评估。通过对用户、学习资源和学用数据多维分析处理,实现对远程教育开展情况、资源使用情况、教学资源质量进行数据分析和趋势分析,为远程教育发展提供决策辅助支持。在远程教育实践中应用表明,大数据分析平台功能设计合理,能够为远程教育实践提供有效数据支撑,明显提升农民远程教育的服务水平和服务能力。

关键词: 远程教育, 大数据, Spark, 数据管理, 评估模型, 可视化, 农业大数据, 数据平台

Abstract:

Developing modern distance learning for farmers is an important strategy to improve the level of rural informatization and eliminate the digital divide. Construction of a big data analysis platform for farmers' distance learning is of great significance for improving the service level and service capability of distance learning. Based on data accumulated from a farmers' distance learning platform over many years, this paper reviews, aggregates, standardizes, and establishes a unified data management system, by collecting and integrating user learning data and platform resource data on distance learning. A model database for statistical analysis, representation, and comprehensive evaluation of distance learning data is constructed. HQL and Spark SQL query analysis of data is realized, using Hadoop and Spark big data analysis technology. Through software engineering and database development technology, a big data visualization analysis and management system is realized; evaluation index system management, course organization evaluation, training resource evaluation, and teaching management evaluation are performed. Through multi-dimensional analysis and processing of users, learning resources and learning data, data analysis and trend analysis of distance learning development, and resource use and teaching resource quality are realized, to support decision making for the development of distance learning. The practical application of the platform for distance learning shows that the platform design and function design are reasonable, and that they effectively provide solid data support and significantly improve the service level and service capability of farmers' distance learning.

Key words: distance learning, big data, Spark, data management, evaluation model, visualization, agricultural big data, data platform

中图分类号: 

  • G434