研究论文

基于大数据的遥感参数人工智能反演范式理论形成与工程技术实现

  • 毛克彪 ,
  • 袁紫晋 ,
  • 施建成 ,
  • 武胜利 ,
  • 胡德勇 ,
  • 车进 ,
  • 董立新
展开
  • 1.中国农业科学院农业资源与农业区划研究所 北方干旱半干旱耕地高效利用全国重点实验室,北京 100081
    2.宁夏大学电子与电气工程学院,银川,750021
    3.中国科学院空天信息创新研究院 遥感科学国家重点实验室,北京 100094
    4.中国科学院国家空间科学中心,北京100190
    5.国家卫星气象中心,北京100081
    6.首都师范大学资源环境与旅游学院,北京 100048

收稿日期: 2023-05-28

  录用日期: 2023-09-13

  网络出版日期: 2024-01-05

基金资助

国家重点研发计划项目“全球粮食和病虫害监测与预警(2023YFB3906202)

Theory and Engineering Technology Implementation of Artificial Intelligence Retrieval Paradigm for Parameters of Remote Sensing Based on Big Data

  • KeBiao MAO ,
  • ZiJin YUAN ,
  • JianCheng SHI ,
  • ShengLi WU ,
  • DeYong HU ,
  • Jin CHE ,
  • LiXin DONG
Expand
  • 1. State Key Laboratory of Efficient Utilization of Arid and Semi-arid Arable Land in Northern China, Institute of Agricultural Resources and Regional Planning, Chinese Academy of Agricultural Sciences,Beijing 100081
    2. School of Physics and Electronic-Electrical Engineering, Ningxia University, Yinchuan, 750021
    3. State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Science, Beijing, 100094
    4. National Space Science Center, Chinese Academy of Sciences, Beijing 100190
    5. National Satellite Meteorological Center, Beijing 100081
    6. College of Resource Environment & Tourism, Capital Normal University, Beijing 100048

Received date: 2023-05-28

  Accepted date: 2023-09-13

  Online published: 2024-01-05

摘要

为了解决人工智能(Artificial Intelligence)应用在地球物理参数反演中的“黑箱”问题,使得人工智能应用具有物理意义和可解释性及普适性,深度学习耦合物理方法和统计方法的理论和技术在各学科领域正在陆续展开。本研究通过梳理作者20余年的相关研究,在前面归纳和演绎得到人工智能地球物理参数反演范式理论和判定条件基础上,分别给出了遥感参数人工智能反演范式和判定条件。目前大家研究普遍遇到一个问题,很多人工智能参数反演理论模拟数据反演精度非常高,但实际应用反演精度不理想,因此深度学习如何耦合物理方法和统计方法成为当前亟须解决的工程与技术难题。我们以被动微波土壤水分和地表温度反演为例进行阐述,分析表明物理模型本身的精度还要很大的提升空间或者模拟数据只代表现实情况中的少部分情况。因此只利用物理模型模拟数据直接进行反演还存在很大的局限,必须补充大量高精度的多源统计观测数据。同时可以通过利用模拟数据对深度学习训练和用实际数据检验物理模型的误差。统计方法是人类最直观的描述,物理方法是对统计方法的归纳演绎总结,但真实世界的信息或能量传输是按量子形式传递,物理模型只是当前人们认识世界的最高形式,大部分模型并没有刻画好真实信息流。深度学习中的不同神经元更适合描述和表达量子信息的传输方式,以微积分量子能量信息流认识真实世界需要提高人类的思维认知方式,这才是最高模式。如何采集满足真实情况(量子信息或能量传输)的数据显得非常重要,当前可以充分利用物理逻辑推理构建物理方法和统计方法,并在范式理论和判定条件框架指导下利用大数据思维模式提高地球物理参数反演精度。通过物理逻辑推理证明输入变量能唯一确定输出变量是形成具有物理意义和可解释及通用的反演或分类或预测范式的基本条件,从量子信息(能量)传输真实角度控制采集数据质量是地球物理参数高精度反演工程与技术实现的关键,提高微积分量子信息流思维认知和甄辨物理模型的局限对实现人工智能高精度反演具有里程碑意义。

本文引用格式

毛克彪 , 袁紫晋 , 施建成 , 武胜利 , 胡德勇 , 车进 , 董立新 . 基于大数据的遥感参数人工智能反演范式理论形成与工程技术实现[J]. 农业大数据学报, 2023 , 5(4) : 1 -12 . DOI: 10.19788/j.issn.2096-6369.230401

Abstract

In order to solve the "black box" problem of artificial intelligence application in geophysical parameter retrieval, and make artificial intelligence applications have physical significance, interpretability, and universality, the theory and technology of deep learning coupling physical and statistical methods are gradually being developed in various disciplinary fields. This study summarizes the author's more than 20 years of relevant research, and presents the artificial intelligence inversion paradigms and judgment conditions for remote sensing parameters based on the induction and deduction of the theory and judgment conditions of artificial intelligence geophysical parameter inversion paradigms. At present, a common problem encountered in many studies is that many artificial intelligence parameter retrieval uses theoretical simulation data to achieve high retrieval analysis accuracy, but the actual application retrieval accuracy is not ideal. Therefore, deep learning how to couple physical and statistical methods has become an urgent engineering and technical challenge that needs to be addressed. We will take passive microwave soil moisture and surface temperature retrieval as an example to illustrate that the accuracy of the physical model itself still needs to be greatly improved, or the simulated data only represents a small portion of the actual situation. We believe that there are significant limitations in using only physical models to simulate data for direct retrieval, and high-precision multi-source statistical data must be supplemented. At the same time, we can also improve the physical model by directly using deep learning to simulate data training and testing with actual data to verify the gap between the physical model and the actual situation, determine the errors of the physical model, and thus improve the physical model. Statistical methods are the most intuitive description of human beings, while physical methods summarize and generalize statistical methods. However, information or energy transmission in the real world is transmitted in quantum form, and many physical models have made many simplifications without depicting real physical phenomena well. Different neurons in deep learning are more suitable for describing and expressing the transmission methods of quantum information. Understanding the real world through calculus quantum information flow requires improving our cognitive thinking. How to collect data that meets the real situation (quantum information or energy transmission) is very important. We can fully utilize physical logic reasoning to construct physical formulas and statistical methods, and use big data thinking mode to improve the accuracy of geophysical parameter inversion under the guidance of paradigm theory and judgment condition framework. Proving through physical logic reasoning that the input variable can uniquely determine the output variable is a fundamental condition for forming a physically meaningful, interpretable, and universal retrieval or classification or prediction paradigm. Controlling the quality of collected data from the perspective of quantum information (energy) transmission is the key to achieving high-precision inversion engineering and technology for geophysical parameters. Improving the cognitive understanding of quantum information flow in calculus and identifying the limitations of physical models are of milestone significance for achieving high-precision inversion in artificial intelligence.

参考文献

[1] 毛克彪, 张晨阳, 施建成, 等. 基于人工智能的地球物理参数反演范式理论及判定条件[J]. 智慧农业, 2023, 5(2): 161-171.
[2] MAO K B, WANG H, SHI J C, et al. A general paradigm for retrieving soil moisture and surface temperature from passive microwave remote sensing data based on artificial intelligence[J]. Remote Sensing, 2023, 15(7): 1793.
[3] MAO K, SHI J, LI Z, et al. Land surface temperature and emissivity retrieved from the AMSR passive microwave data[C/OL]. International Geoscience and Remote Sensing Symposium (IGARSS05), 25-29 July 2005. DOI:10.1109/IGARSS.2005.1525420.
[4] 毛克彪, 施建成, 李召良, 等. 用被动微波AMSR数据反演地表温度及发射率方法研究[J]. 自然资源遥感, 2005(3):14-18.
[5] 毛克彪, 施建成, 李召良, 等. 一个针对被动微波数据AMSR-E数据反演地表温度的物理统计算法[J]. 中国科学D辑, 2006, 36(12):1170-1176.
[6] MAO K B, SHI J C, TANG H J, et al. A neural-network technique for retrieving land surface temperature from AMSR-E passive microwave data[C/OL]. International Geoscience and Remote Sensing Symposium (IGARSS07), 23-28 July 2007. DOI:10.1109/IGARSS. 2007.44238357.
[7] 毛克彪, 王道龙, 李滋睿, 等. 利用AMSR-E被动微波数据反演地表温度的神经网络算法[J]. 高技术通讯, 2009, 19(11): 1195-1200.
[8] MAO K B, ZUO Z Y, SHEN X Y, et al. Retrieval of land-surface temperature from AMSR2 data using a deep dynamic learning neural network[J]. Chinese Geographical Science, 2018, 28(1): 1-11.
[9] TAN J C, NOURELDEEN N, MAO K B, et al. Deep learning convolutional neural network for the retrieval of land surface temperature from AMSR2 data in China[J]. Sensors, 2019, 19(13):ID 2987.
[10] MAO K, TANG H, ZHANG L, et al. A method for retrieving soil moisture in Tibet region by utilizing microwave index from TRMM/TMI data[J]. International Journal of Remote Sensing, 2008, 29(10): 2905-2925.
[11] 毛克彪, 胡德勇, 黄健熙, 等. 针对被动微波数据AMSR-E数据的土壤水分反演算法[J]. 高技术通讯, 2010, 20(6): 651-659.
[12] 谭建灿, 毛克彪, 左志远, 等. 基于卷积神经网络和AMSR2 微波遥感的土壤水分反演研究[J]. 高技术通讯, 2018, 8(5):399-408.
[13] 毛克彪, 覃志豪, 施建成, 等. 针对MODIS影像的劈窗算法研究[J]. 武汉大学学报(信息科学版), 2005, 30(8):703-707.
[14] MAO K B, QIN Z, SHI J, et al. A practical split-window algorithm for retrieving land surface temperature from MODIS data[J]. International Journal of Remote Sensing, 2005, 26:3181-3204.
[15] 毛克彪, 覃志豪, 宫鹏, 等. 劈窗算法LST精度评价和参数敏感性分析[J]. 中国矿业大学学报, 2005(3):318-322.
[16] QIN Z H, DALL'OLMO G, KARNIELI A, et al. Derivation of split window algorithm and its sensitivity analysis for retrieving land surface temperature from NOAA-advanced very high resolution radiometer data[J]. Journal of Geophysical Research: Atmospheres, 2001, 106(D19): 22655-22670.
[17] WAN Z, DOZIER J. A generalized split-window algorithm for retrieving land surface temperature measurement from space[J]. IEEE Transactions on Geoscience and Remote Sensing, 1996, 34:892-905.
[18] LI Z L, BECKER F. Feasibility of land surface temperature and emissivity determination from AVHRR data[J]. Remote Sensing of Environment, 1993, 43(1): 67-85.
[19] WAN Z M, LI Z L. A Physics-based algorithm for retrieving land-surface emissivity and temperature from EOS/MODIS data[J]. IEEE Transactions on Geoscience and Remote Sensing, 1997, 35: 980-996.
[20] 毛克彪, 施建成, 覃志豪, 等. 一个针对ASTER数据同时反演地表温度和比辐射率的四通道算法[J]. 遥感学报, 2006, 10(4):593-599.
[21] 毛克彪, 唐华俊, 李丽英, 等. 一个从MODIS数据同时反演地表温度和发射率的神经网络算法[J]. 遥感信息, 2007, 22(4):9-15, 8.
[22] 毛克彪, 唐华俊, 陈仲新, 等. 一个用神经网络优化的针对ASTER数据反演地表温度和发射率的多波段算法[J]. 国土资源遥感, 2007, 19(3): 18-22.
[23] MAO K B, SHI J C, LI Z L, et al. An RM-NN algorithm for retrieving land surface temperature and emissivity from EOS/MODIS data[J]. Journal of Geophysical Research: Atmospheres, 2007, 112(D21): ID D21102.
[24] MAO K B, SHI J C, TANG H J, et al. A neural network technique for separating land surface emissivity and temperature from ASTER imagery[J]. IEEE Transactions on Geoscience and Remote Sensing, 2008, 46(1):200-208.
[25] MAO K B, LI S M, WANG D L, et al. Retrieval of land surface temperature and emissivity from ASTER1B data using a dynamic learning neural network[J]. International Journal of Remote Sensing, 2011, 32(19):5413-5423.
[26] 毛克彪, 杨军, 韩秀珍, 等. 基于深度动态学习神经网络和辐射传输模型地表温度反演算法研究[J]. 中国农业信息, 2018, 30(5):47-57.
[27] WANG H, MAO K B, YUAN Z J, et al. A method for land surface temperature retrieval based on model-data-knowledge-driven and deep learning[J]. Remote sensing of environment, 2021, 265: ID 112665.
[28] CRESSWELL M P, MORSE A P, THOMSON M C, et al. Estimating surface air temperatures, from Meteosat land surface temperatures, using an empirical solar zenith angle model[J]. International Journal of Remote Sensing, 1999, 20(6):1125-32.
[29] MOSTOVOY G V, KING R L, REDDY K R, et al. Statistical estimation of daily maximum and minimum air temperatures from MODIS LST data over the state of Mississippi[J]. Mapping Sciences & Remote Sensing, 2006, 43(1):78-110.
[30] 徐永明, 覃志豪, 万洪秀. 热红外遥感反演近地层气温的研究进展[J]. 国土资源遥感, 2011(1): 9-14.
[31] MAO K B, TANG H J, WANG X F, et al. Near-surface air temperature estimation from ASTER data based on neural network algorithm[J]. International Journal of Remote Sensing, 2008, 29(20): 6021-6028.
[32] 毛克彪, 马莹, 夏浪, 等. 用MODIS数据反演近地表空气温度的RM-NN算法[J]. 高技术通讯, 2013, 23(5):462-466.
[33] DU B Y, MAO K B, BATENI S M, et al. A novel fully coupled physical-statistical-deep learning method for retrieving near-surface air temperature from multisource data[J]. Remote Sensing, 2022, 14(22): ID 5812.
[34] MAO K, QIN Z, XU B, et al. The Influence analysis of water content for the accuracy of practical split-window algorithm[C]. International Geoscience and Remote Sensing Symposium (IGARSS05), 25-29 July 2005. DOI:10.1109/IGARSS.2005.1526538.
[35] 毛克彪, 唐华俊, 周清波, 等. 实用劈窗算法的改进及大气水汽含量对精度影响评价[J]. 武汉大学学报(信息科学版), 2008, 33(2): 116-119.
[36] MAO K B, LI H T, HU D Y, et al. Estimation of water vapor content in near-infrared bands around 1 μm from MODIS data by using RM-NN[J]. Optics Express, 2010, 18(9): 9542-9554.
[37] MAO K B, SHEN X Y, ZUO Z Y, et al. An advanced radiative transfer and neural network scheme and evaluation for estimating water vapor content from MODIS data[J]. Atmosphere, 2017, 8(8):ID 139.
[38] MEI R, MAO K B, SHI J, et al. A novel physics-statistical coupled paradigm for retrieving integrated water vapor content based on artificial intelligence[J]. Remote Sensing, 2023, 15(17):4250. https:// doi.org/ 10.3390/rs15174250.
[39] CHEN K S, WU T, TSANG L, et al. Emission of rough surfaces calculated by the integral equation method with comparison to three-dimensional moment method simulations[J]. IEEE Transactions on Geoscience and Remote Sensing, 2003, 44(1):90-101.
[40] 毛克彪, 覃志豪. 大气辐射传输模型及MODTRAN中大气透过率计算[J]. 空间与测绘, 2004, 27(2):1-3.
文章导航

/