Abstract:The Boltzmann equation is a partial differential equation that describes the variation of particles in a non-equilibrium thermodynamic system. In the field of gas insulation and plasma discharge, the Boltzmann equation can be used to accurately describe the electron transport in gas discharge plasmas, and its solution is the basis of many plasma simulation models. However, the traditional numerical methods for solving the Boltzmann equation all require meshing on the computational domain, and the solution accuracy significantly depends on the quality of the meshing. The physics-informed neural networks (PINNs), as a new method for solving Boltzmann equation, overcomes the shortcomings of traditional numerical methods in mesh generation and equation discretization, but its training is inefficient when dealing with multi-tasks because of huge parameter space of PINNs. To address this issue, this paper proposes a Meta-PINN network with two loops of PINNs based on meta learning. Through the training in inner and outer loops, Meta-PINN solve the Boltzmann equation in multi-tasks accurately and efficiently. In the Meta-PINN, there are two types of networks, which are the PINN network and the meta network. In the inner loop, the PINN network solve the Boltzmann equation in multi-tasks by minimizing the loss function of PINN. After all multi-tasks are optimized, the sum of the PINN loss function, namely the meta loss function, is obtained. Then, the meta network updates the weights by minimizing the meta loss function in the outer loop. Finally, the updated weights are used to improve the training efficiency when dealing with new tasks of solving Boltzmann equations. To validate the performance of Meta-PINN, the Boltzmann equations under different reduced electric fields and gas mixing ratios are solved under the framework of Meta-PINN. The results show that, when dealing with new tasks, the loss function values and L2 errors of Meta-PINN are reduced faster than that of PINN. Specifically, the minimum and maximum acceleration speeds increase by 75% and 22 times respectively, which indicates that the Meta-PINN outperforms the PINN in solution efficiency. Additionally, the effects of network capacities and inner steps on the computational efficiency are investigated in multi-tasks of solving Boltzmann equation. The result reveals that the computational efficiency does not improve with the increase of network capacities and is less affected by the inner steps. The following conclusions could be drawn from the numerical experiments: (1) Meta-PINN can improve the efficiency of solving Boltzmann equation describing electron transport in gas discharge plasmas. Moreover, in some cases, the loss function value and L2 error of Meta-PINN can be reduced to a lower order of magnitude than PINN, indicating that solution accuracy of Meta-PINN is also better than that of PINN. (2) In solving the Boltzmann equation, the computation efficiency is not improved with the increase of network capacity. The most suitable network for solving the Boltzmann equation under different reduced electric fields in argon plasma is the neural network with 3 hidden layers and 300 neurons per layer. (3) The computation efficiency is either not improved with the increase of inner steps. The most suitable inner steps for solving the Boltzmann equation under different reduced electric fields in argon plasma is 5 steps. Generally, the Meta-PINN can be extended easily to other numerical solution of plasma governing equations.
仲林林, 吴冰钰, 吴奇. 基于元学习的气体放电等离子体电子Boltzmann方程数值求解[J]. 电工技术学报, 2024, 39(11): 3457-3466.
Zhong Linlin, Wu Bingyu, Wu Qi. Numerical Solution of Electron Boltzmann Equation in Gas Discharge Plasmas Based on Meta Learning. Transactions of China Electrotechnical Society, 2024, 39(11): 3457-3466.
[1] Reid I D.An investigation of the accuracy of numerical solutions of Boltzmann's equation for electron swarms in gases with large inelastic cross sections[J]. Australian Journal of Physics, 1979, 32(3): 231-254. [2] 赵谡, 邓云坤, 钟蕊霜, 等. 基于Boltzmann方程的CF3I混合气体协同效应分析[J]. 电工技术学报, 2019, 34(7): 1553-1558. Zhao Su, Deng Yunkun, Zhong Ruishuang, et al.Investigation on the synergistic effect of CF3I gas mixtures using Boltzmann Equation[J]. Transactions of China Electrotechnical Society, 2019, 34(7): 1553-1558. [3] 徐玲铃, 程林, 杜玮杰, 等. CF3I三元混合气体绝缘特性的Boltzmann分析[J]. 高电压技术, 2017, 43(3): 721-726. Xu Lingling, Cheng Lin, Du Weijie, et al.Analysis of the insulation characteristic of CF3I ternary gas mixture using Boltzmann's equation[J]. High Voltage Engineering, 2017, 43(3): 721-726. [4] 李冰, 邓云坤, 肖登明. 基于Boltzmann方程的C3F8及C3F8-N2混合气体绝缘性能[J]. 高电压技术, 2015, 41(12): 4150-4157. Li Bing, Deng Yunkun, Xiao Dengming.Insulation characteristics of C3F8 and C3F8-N2 gas mixture using Boltzmann equation method[J]. High Voltage Engineering, 2015, 41(12): 4150-4157. [5] 陈赦, 刘红梅, 吴婷, 等. 低温等离子体增强催化氨合成机理的一维流体动力学模型[J]. 电工技术学报, 2021, 36(13): 2730-2739. Che She, Liu Hongmei, Wu Ting, et al.1D fluid model of catalytic ammonia synthesis enhanced by low temperature plasma[J]. Transactions of China Electrotechnical Society, 2021, 36(13): 2730-2739. [6] 何彦良, 丁未, 孙安邦, 等. 电场不均匀系数对SF6/N2混合气体负直流电晕电流脉冲特性的影响[J]. 电工技术学报, 2021, 36(15): 3124-3134. He Yanliang, Ding Wei, Sun Anbang, et al.Effect of electric field non-uniformity coefficient on current pulse characteristics of negative DC corona in SF6/N2 gas mixtures[J]. Transactions of China Electrotechnical Society, 2021, 36(15): 3124-3134. [7] 郝莎, 徐建源, 林莘. 隔离开关电弧流体数学模型研究与应用[J]. 电工技术学报, 2021, 36(13): 2710-2718. Hao Sha, Xu Jianyuan, Lin Xin.Study on the application of fluid arc model in disconnector[J]. Transactions of China Electrotechnical Society, 2021, 36(13): 2710-2718. [8] 李泳霖, 黄世龙, 刘云鹏, 等. 考虑湿度气压影响的瓷绝缘子沿面类辉光放电仿真及其紫外光谱特性分析[J]. 电工技术学报, 2023, 38(7): 1956-1969. Li Yonglin, Huang Shilong, Liu Yunpeng, et al.Simulation and ultraviolet spectral characteristics of glow-like discharge along the surface of porcelain insulators considering the influences of the humidity and atmospheric pressure[J]. Transactions of China Electrotechnical Society, 2023, 38(7): 1956-1969. [9] Alder B J, Wainwright T E.Studies in molecular dynamics. I. General method[J]. The Journal of Chemical Physics, 1959, 31(2): 459-466. [10] Itoh H, Ikuta N, Toyota K.Boltzmann equation analysis of electron swarms for model cases with power-law elastic scattering[J]. Journal of Physics D: Applied Physics, 1983, 16(3): 293. [11] 刘宇琦, 李硕, 刘世宇, 等. 基于二项近似解玻尔兹曼方程计算CF3I/N2混合气体的绝缘特性[J]. 电气技术, 2019, 20(4): 32-36. Liu Yuqi, Li Shuo, Liu Shiyu, et al.Solving the boltzmann equation to obtain insulation properties of CF3I/N2 gas mixtures based on two-term approximation[J]. Electrical Engineering, 2019, 20(4): 32-36. [12] Vecchi M C, Rudan M.Modeling electron and hole transport with full-band structure effects by means of the spherical-harmonics expansion of the BTE[J]. IEEE Transactions on Electron Devices, 1998, 45(1): 230-238. [13] Hennacy K A, Wu Y J, Goldsman N, et al.Deterministic MOSFET simulation using a generalized spherical harmonic expansion of the Boltzmann equation[J]. Solid-State Electronics, 1995, 38(8): 1485-1495. [14] 蔡新景, 王新新, 邹晓兵, 等. 基于改进的多项近似法解玻尔兹曼方程计算电子输运系数[J]. 中国电机工程学报, 2016, 36(4): 1148-1155. Cai Xinjing, Wang Xinxin, Zou Xiaobing, et al.Computation of electron transport coefficients based on improved multi-term approximation of the Boltzmann equation[J]. Proceedings of the CSEE, 2016, 36(4): 1148-1155. [15] Rupp K, Jüngel A, Grasser T.Matrix compression for spherical harmonics expansions of the Boltzmann transport equation for semiconductors[J]. Journal of Computational Physics, 2010, 229(23): 8750-8765. [16] Hong S M, Matz G, Jungemann C.A deterministic Boltzmann equation solver based on a higher order spherical harmonics expansion with full-band effects[J]. IEEE Transactions on Electron Devices, 2010, 57(10): 2390-2397. [17] Raissi M, Perdikaris P, Karniadakis G E.Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations[J]. Journal of Computational Physics, 2019, 378: 686-707. [18] Yang Yibo, Perdikaris P.Adversarial uncertainty quantification in physics-informed neural networks[J]. Journal of Computational Physics, 2019, 394: 136-152. [19] Pang Guofei, Lu Lu, Karniadakis G E. fPINNs: fractional physics-informed neural networks[J]. SIAM Journal on Scientific Computing, 2019, 41(4): A2603-A2626. [20] Meng Xuhui, Li Zhen, Zhang Dongkun, et al.PPINN: Parareal physics-informed neural network for time-dependent PDEs[J]. Computer Methods in Applied Mechanics and Engineering, 2020, 370: 113250. [21] Chen Xiaoli, Duan Jinqiao, Karniadakis G E.Learning and meta-learning of stochastic advection-diffusion-reaction systems from sparse measurements[J]. European Journal of Applied Mathematics, 2021, 32(3): 397-420. [22] Zhong Linlin, Wu Bingyu, Wang Yifan.Low-temperature plasma simulation based on physics-informed neural networks: frameworks and preliminary applications[J]. Physics of Fluids, 2022, 34(8): 087116. [23] Kawaguchi S, Takahashi K, Ohkama H, et al.Deep learning for solving the Boltzmann equation of electrons in weakly ionized plasma[J]. Plasma Sources Science and Technology, 2020, 29(2): 025021. [24] 孙广雷, 林莘, 夏亚龙, 等. 热态SF6/CF4击穿特性研究[J]. 高压电器, 2021, 57(3): 65-70. Sun Guanglei, Lin Xin, Xia Yalong, et al.Study on breakdown characteristic of hot SF6/CF4[J]. High Voltage Apparatus, 2021, 57(3): 65-70. [25] 李祎, 张晓星, 傅明利, 等. 环保绝缘气体C4F7N研究及应用进展Ⅰ: 绝缘及电、热分解特性[J]. 电工技术学报, 2021, 36(17): 3535-3552. Li Yi, Zhang Xiaoxing, Fu Mingli, et al.Research and application progress of eco-friendly gas insulating medium C4F7N, part Ⅰ: insulation and electrical, thermal decomposition properties[J]. Transactions of China Electrotechnical Society, 2021, 36(17): 3535-3552. [26] Psaros A F, Kawaguchi K, Karniadakis G E.Meta-learning PINN loss functions[J]. Journal of Computational Physics, 2022, 458: 111121. [27] Wang J X.Meta-learning in natural and artificial intelligence[J]. Current Opinion in Behavioral Sciences, 2021, 38: 90-95. [28] Zhong Linlin, Wu Bingyu, Wang Yifan.Accelerating physics-informed neural network based 1D arc simulation by meta learning[J]. Journal of Physics D: Applied Physics, 2023, 56(7): 074006. [29] Kayaalp M, Vlaski S, Sayed A H.Dif-MAML: Decentralized multi-agent meta-learning[J]. IEEE Open Journal of Signal Processing, 2022, 3: 71-93. [30] Penwarden M, Zhe S, Narayan A, et al.A metalearning approach for physics-informed neural networks (PINNs): application to parameterized PDEs[J]. Journal of Computational Physics, 2023, 477: 111912. [31] 傅世元, 高欣, 张浩, 等. 基于元学习动态选择集成的电力调度数据异常检测方法[J]. 电网技术, 2022, 46(8): 3248-3261. Fu Shiyuan, Gao Xin, Zhang Hao, et al.Anomaly detection for power dispatching data based on meta-learning dynamic ensemble selection[J]. Power System Technology, 2022, 46(8): 3248-3261. [32] 游文霞, 李清清, 杨楠, 等. 基于多异学习器融合Stacking集成学习的窃电检测[J]. 电力系统自动化, 2022, 46(24): 178-186. You Wenxia, Li Qingqing, Yang Nan, et al.Electricity theft detection based on multiple different learner fusion by Stacking ensemble learning[J]. Automation of Electric Power Systems, 2022, 46(24): 178-186. [33] Finn C, Rajeswaran A, Kakade S, et al.Online meta-learning[C]//International Conference on Machine Learning, California, USA, 2019: 1920-1930. [34] 邓云坤, 马仪, 赵谡, 等. 基于电子输运参数的CF3I及CF3I-N2混合气体绝缘性能分析[J]. 电工技术学报, 2018, 33(7): 1641-1651. Deng Yunkun, Ma Yi, Zhao Su, et al.Analysis of the insulation properties of CF3I and CF3I-N2 gas mixtures from electron transport parameters[J]. Transactions of China Electrotechnical Society, 2018, 33(7): 1641-1651.