电子、通信与自动控制

基于集合卡尔曼-Elman网络的软测量建模方法

展开
  • 1.华南理工大学 自动化科学与工程学院/自主系统与网络控制教育部重点实验室,广东 广州 510640
    2.华南理工大学 未来技术学院,广东 广州 511442
    3.广州工业智能研究院,广东 广州 511458
    4.广西科技大学 广西汽车零部件与整车技术重点实验室,广西 柳州 545036
    5.华南理工大学 广东省无人机系统工程技术研究中心,广东 广州 510640
方港(1997-),男,博士生,主要从事软测量建模研究。E-mail:aufang@mail.scut.edu.cn

收稿日期: 2022-09-26

  网络出版日期: 2022-12-06

基金资助

国家自然科学基金资助项目(62273151);广东省基础与应用基础研究基金资助项目(2021B1515420003);广东省国际合作基金资助项目(2020A0505100024)

Soft-Sensor Modeling Method Based on Ensemble Kalman Filter-Elman Neural Network

Expand
  • 1.School of Automation Science and Engineering/Key Laboratory of Autonomous Systems and Networked Control of the Ministry of Education,South China University of Technology,Guangzhou 510640,Guangdong,China
    2.School of Future Technology,South China University of Technology,Guangzhou 511442,Guangdong,China
    3.Guangzhou Industrial Intelligence Research Institute,Guangzhou 511458,Guangdong,China
    4.Guangxi Key Laboratory of Automobile Components and Vehicle Technology,Guangxi University of Science and Technology,Liuzhou 545036,Guangxi,China
    5.Unmanned Aerial Vehicle Systems Engineering Technology Research Center of Guangdong,South China University of Technology,Guangzhou 510640,Guangdong,China
方港(1997-),男,博士生,主要从事软测量建模研究。E-mail:aufang@mail.scut.edu.cn

Received date: 2022-09-26

  Online published: 2022-12-06

Supported by

the National Natural Science Foundation of China(62273151);the Basic and Applied Basic Research Foundation of Guangdong Province(2021B1515420003);the International Cooperation Foundation of Guangdong Province(2020A0505100024)

摘要

污水处理系统是一个复杂的非线性、大时延的动态系统,由于工艺的复杂性、检测设备的不完备性以及经济成本的限制,一些重要的出水指标无法实现精准的检测。为解决此问题,文中提出了基于集合卡尔曼-Elman网络的软测量方法传统动态神经网络具有能够处理时延信息数据的动态记忆能力,可用于基于数据驱动的软测量建模过程。但是,常规训练方法容易使神经网络陷入局部最小值,导致模型预测性能欠佳。鉴于此,文中引入集合卡尔曼滤波技术和对偶有限样本集合卡尔曼技术对典型的动态神经网络——Elman神经网络进行无梯度训练,构建新型软传感器模型,不仅有效提高了传统Elman神经网络的预测能力,而且提供了一种简单、无梯度的神经网络训练方法。将该方法在加州大学欧文分校的污水处理数据(UCI数据)上进行验证,结果表明,文中方法具有较好的预测性能,集合卡尔曼滤波技术可作为一种无梯度的替代方法来训练神经网络。

本文引用格式

方港, 袁珑华, 王晓明, 等 . 基于集合卡尔曼-Elman网络的软测量建模方法[J]. 华南理工大学学报(自然科学版), 2023 , 51(8) : 126 -136 . DOI: 10.12141/j.issn.1000-565X.220625

Abstract

Wastewater treatment system is a dynamic system with complex nonlinearity and large time delay. Due to the complexity of the process, the incompleteness of the testing equipment and the constraint of economic cost, some important effluent indicators cannot be detected accurately. To solve this problem, this paper proposes a soft-sensor method based on an ensemble Kalman filter-Elman neural network. The traditional dynamic neural network has the dynamic memory ability to process time-delay data, so it can be used in data-driven soft sensing modeling. However, the conventional training method is easy to trap in a local minimum, resulting in poor prediction performance. This paper introduces the ensemble Kalman filter and the dual finite-size ensemble Kalman filter, and, together with the Elman neural network for gradient-free training, to construct two soft sensor models, which not only improve the prediction performance of Elman neural network but also provide a simple and gradient-free training method for neural network. The two models are then applied to a dataset of the University of California, Irvine (UCI data). The results show that the proposed method based on ensemble Kalman filter-Elman neural network possesses good prediction performance, and that the ensemble Kalman filter can be used as an alternative gradient-free method to train neural networks.

参考文献

1 黄道平,刘乙奇,李艳 .软测量在污水处理过程中的研究与应用[J].化工学报201162(1):1-9.
  HUANG Daoping, LIU Yiqi, LI Yan .Soft sensor research and its application in wastewater treatment[J].CIESC Journal201162(1):1-9.
2 GENG Z, CHEN Z, MENG Q,et al .Novel transformer based on gated convolutional neural network for dynamic soft sensor modeling of industrial processes[J].IEEE Transactions on Industrial Informatics202118(3):1521-1529.
3 KADLEC P, GABRYS B, STRANDT S .Data-driven soft sensors in the process industry[J].Computers & Chemical Engineering200933(4):795-814.
4 KAY S,KAY H, MOWBRAY M,et al .Integrating autoencoder and heteroscedastic noise neural networks for the batch process soft-sensor design[J].Industrial & Engineering Chemistry Research202261(36):13559-13569.
5 李东,黄道平,许翀,等 .基于协同训练的集成自适应GPR-RVM多输出模型研究[J].华南理工大学学报(自然科学版)202149(6):100-108.
  LI Dong, HUANG Daoping, XU Chong,et al .On integrated adaptive GPR-RVM multi-output model based on co-training algorithm[J].Journal of South China University of Technology (Natural Science Edition)202149(6):100-108.
6 YUAN X, LI L, WANG Y,et al .Deep learning for quality prediction of nonlinear dynamic processes with variable attention‐based long short‐term memory network[J].The Canadian Journal of Chemical Engineering202098(6):1377-1389.
7 GENCAY R, LIU T .Nonlinear modelling and prediction with feedforward and recurrent networks[J].Physica D:Nonlinear Phenomena1997108(1/2):119-134.
8 杨马英,周芳芹,李军 .基于Elman神经网络的城市污水处理水质参数软测量[J].东南大学学报(自然科学版)200636(S1):119-123.
  YANG Maying, ZHOU Fangqin, LI Jun .Soft sensing model for city wastewater treatment process parameter based on Elman neural network[J].Journal of Southeast University (Natural Science Edition)200636(S1):119-123.
9 关学忠,宋韬略,徐延海,等 .污水处理中BP神经网络与Elman神经网络的预测比较[J].自动化技术与应用201433(10):1-3,25.
  GUAN Xuezhong, SONG Taolue, XU Yanhai,et al .Comparison of prediction on BP neural networks and Elman neural networks in wastewater treatment[J].Techniques of Automation and Applications201433(10):1-3,25.
10 WERBOS P J .Backpropagation through time:what it does and how to do it[J].Proceedings of the IEEE199078(10):1550-1560.
11 HAGAN M T, MENHAJ M B .Training feedforward networks with the Marquardt algorithm[J].IEEE Transactions on Neural Networks19945(6):989-993.
12 HOWARD B D, MARK H B, ORLANDO De J,et al .Neural network design[M].Stillwater:Oklahoma State University,2014:335-468.
13 ZHANG F, REYNOLDS A C, OLIVER D S .An initial guess for the Levenberg-Marquardt algorithm for conditioning a stochastic channel to pressure data[J].Mathematical Geology200335(1):67-88.
14 ZHU J, JIANG Q, SHEN Y,et al .Application of recurrent neural network to mechanical fault diagnosis:a review[J].Journal of Mechanical Science and Technology202236:527-542.
15 WELCH G, BISHOP G .An introduction to the kalman filter[R].Raleigh:University of North Carolina,2006
16 NOVI T, CAPITANI R, ANNICCHIARICO C .An integrated artificial neural network-unscented Kalman filter vehicle sideslip angle estimation based on inertial measurement unit measurements[J].Proceedings of the Institution of Mechanical Engineers,Part D:Journal of Automobile Engineering2019233(7):1864-1878.
17 HAO Y, QIU X .Performance analysis of wireless location and velocity tracking of digital broadcast signals based on extended Kalman filter algorithm[J].Complexity2021(2021):1-10.
18 李小兵,田玉松,邱天爽 .基于Kalman滤波的基本Elman网络训练新算法[J].大连理工大学学报200949(2):276-281.
  LI Xiao-bing, TIAN Yu-song, QIU Tian-shuang .A new training algorithm based on Kalman filter of essential Elman network[J].Journal of Dalian University of Technology200949(2):276-281.
19 WANG J, ZHANG J, WANG Y,et al .Nonlinear identification of one-stage spur gearbox based on pseudo-linear neural network[J].Neurocomputing2018308:75-86.
20 CHEN C, DOU Y, CHEN J,et al .A novel neural network training framework with data assimilation[J].Journal of Supercomputing202278(17):19020-19045.
21 ROTH M, HENDEBY G, FRITSCHE C,et al .The ensemble Kalman filter:a signal processing perspective[J].EURASIP Journal on Advances in Signal Proce-ssing2017,2017(1):1-16.
22 EVENSEN G .Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics[J].Journal of Geophysical Research199499:10143-10162.
23 LEGLER S, JANJI? T .Combining data assimilation and machine learning to estimate parameters of a convective-scale model[J].Quarterly Journal of the Royal Meteorological Society2022148(743):860-874.
24 MIRIKITANI D T, NIKOLAEV N .Dynamic modeling with ensemble Kalman filter trained recurrent neural networks[C]∥Proceedings of 2008 Seventh International Conference on Machine Learning and Applications.San Diego:IEEE,2008:843-848.
25 CHEN C, LIN X, HUANG Y,et al .Approximate bayesian neural network trained with ensemble Kalman filter[C]∥Proceedings of 2019 International Joint Conference on Neural Networks (IJCNN).Budapest:IEEE,2019:1-8.
26 ELMAN J L .Finding structure in time[J].Cognitive Science199014(2):179-211.
27 EVENSEN G .The ensemble Kalman filter:theoretical formulation and practical implementation[J].Ocean Dynamics200353(4):343-367.
28 MANDEL J .Efficient implementation of the ensemble Kalman filter[R].Denver:University of Colorado at Denver,2006
29 ZUPANSKI M .Maximum likelihood ensemble filter:theoretical aspects[J].Monthly Weather Review2005133(6):1710-1726.
30 BOCQUET M .Ensemble Kalman filtering without the intrinsic need for inflation[J].Nonlinear Processes in Geophysics201118(5):735-750.
31 BOCQUET M, SAKOV P .Combining inflation-free and iterative ensemble Kalman filters for strongly nonlinear systems[J].Nonlinear Processes in Geophysics201219(3):383-399.
32 BOCQUET M, RAANES P N, HANNART A .Expanding the validity of the ensemble Kalman filter without the intrinsic need for inflation[J].Nonlinear Processes in Geophysics201522(6):645-662.
33 LIU Y, HUANG D, LI Y .Development of interval soft sensors using enhanced just-in-time learning and inductive confidence predictor[J].Industrial & Engineering Chemistry Research201251(8):3356-3367.
34 LIU Y, CHEN J, SUN Z,et al .A probabilistic self-validating soft-sensor with application to wastewater treatment[J].Computers & Chemical Engineering201471:263-280.
35 LIU Y, YUAN L, LI D,et al .Process monitoring of quality-related variables in wastewater treatment using Kalman-Elman neural network-based soft-sensor modeling[J].Water202113(24):1-21.
文章导航

/