面向配电网高频采集的云边端协同业务处理机制

doi:10.19595/j.cnki.1000-6753.tces.240627

摘要
图/表
参考文献
相关文章 (15)

全文: PDF (1181 KB)
输出: BibTeX | EndNote (RIS)

摘要

新能源广泛接入背景下,配电网业务数据采集终端接入规模与信号采集频次激增,对网络的业务承载能力提出更高要求。文章通过整合云边端算力资源,构建以最大化云边端协同处理数据量为目标的优化问题,并引入李雅普诺夫优化理论将其转换为仅依赖当前时隙信息的在线优化问题,实现排队时延与长时平均采集数据量的协同保障。进一步提出基于改进深度Q网络（Deep Q-Network,DQN）的配电网云边端协同处理算法,通过引入基于贪婪策略的Q值排序机制与双重经验回放机制,解决多终端处理决策耦合导致的资源竞争冲突,在保障样本多样性处理能力的同时提升算法的收敛性。最后,仿真结果证明所提算法能够有效适配配电网采集业务高密度、高频次的发展趋势。

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	于子淇
	刘健阳
	陈亚鹏
	周振宇
	孙中伟

关键词 ：配电网, 高频采集, 云边端协同, 业务处理, 深度强化学习

Abstract：

With the widespread access of renewable energy, the access scale of distribution network service data acquisition devices and data acquisition frequency have surged. The distribution network acquisition services are rapidly developing towards high-frequency, massive, and computationally intensive directions. It is significant to fully utilize the potential of cloud-edge-end collaboration to enhance the service carrying capacity of the network. Recently, service processing methods based on cloud-edge-end collaboration have been proposed. However, these methods still face several challenges. First, the coupling of long-term constraint guarantees and short-term processing decision optimization makes it difficult for single-slot short-term decisions to achieve long-term constraint coordination. Second, the differentiated performance requirements of services and limited network resources lead to interdependence among multi-device processing decisions. Existing methods lack a collaborative processing mechanism, making it challenging to resolve decision conflicts caused by competition. Finally, most current methods adopt random sampling mechanisms, overlooking the differences among samples in the action experience pool, resulting in poor convergence and optimization performance in resolving competition conflicts under resource-constrained scenarios. To address these challenges, this paper proposes a cloud-edge-end collaborative service processing mechanism for high-frequency data acquisition in distribution network.
Firstly, a cloud-edge-end multi-level collaborative service processing framework for high-frequency acquisition in the distribution network is designed. It constructs differentiated models for local computing, edge processing, and cloud processing to meet the varied computing requirements of data acquisition services. Further, under the premise of ensuring queuing delay and long-term average data collection constraints, the objective of maximizing the amount of cloud-edge-end collaborative processed data is set, which ensures sufficient underlying data support for the normal operation of new power services while reducing queuing delay.
Subsequently, the concept of virtual queues from Lyapunov optimization theory is introduced to transform the original problem into an online optimization problem that only depends on current slot information. It plays an important role in achieving the coordinated guarantee of delay and throughput.
Then, an improved deep Q-network based cloud-edge-end collaborative processing algorithm for distribution network is proposed, which includes five stages of initialization, action selection, conflict resolution, learning, and updating. Specifically, in the action selection and conflict resolution stages, a greedy strategy-based Q-value sorting mechanism is introduced. It selects the action with the highest Q-value as the processing decision of the device for the current slot, and resolves wireless channel and edge server resource selection conflicts caused by multi-device processing decision coupling through edge-end collaboration. In the learning stage, considering the importance of different device services and the confidence of action samples, a dual replay experience pool is designed to ensure sample diversity, effectively avoiding data loss potentially caused by aggressive strategies. This greatly improves the convergence of the algorithm. The proposed algorithm ensures the orderly operation of cloud-edge-end services in distribution networks.
Finally, the effectiveness and rationality of the proposed algorithm are verified through simulation examples. The simulation results show that the proposed algorithm can increase the amount of cloud-edge-end collaborative processed data by 11.71% and 14.86%, reduce queuing delay by 24.68% and 26.09%. It can also increase the average data acquisition volume by 8.87% and 7.44%. At the same time, it significantly reduces the backlog of device layer queue backlog and greatly improves the convergence speed of the algorithm. The author team will further consider information synchronization and security issues during data transmission and processing.

Key words： Distribution network high frequency acquisition cloud-edge-end collaboration service processing deep reinforcement learning

收稿日期: 2024-04-23

PACS:

TM73

基金资助:

国家电网公司总部科技项目（No.52094021N010（5400-202199534A-0-5-ZN）面向智慧园区低碳业务的多模态通信关键技术研究及试点应用）资助

通讯作者: 周振宇男,1983年生,教授,博士生导师,研究方向为新型电力系统与虚拟电厂、无线通信网络与新技术、能源互联网信息通信技术等。E-mail：zhenyu_zhou@ncepu.edu.cn

作者简介: 于子淇女,2000年生,硕士研究生,研究方向为配电网高频采集、云边端协同、电力物联网等。E-mail：ziqi_yu@ncepu.edu.cn

引用本文:

于子淇, 刘健阳, 陈亚鹏, 周振宇, 孙中伟. 面向配电网高频采集的云边端协同业务处理机制[J]. 电工技术学报, 0, (): 240627-240627. Yu Ziqi, Liu Jianyang, Chen Yapeng, Zhou Zhenyu, Sun Zhongwei. Cloud-edge-end Collaborative Service Processing Mechanism for High Frequency Acquisition in Distribution Network. Transactions of China Electrotechnical Society, 0, (): 240627-240627.

链接本文:

https://dgjsxb.ces-transaction.com/CN/10.19595/j.cnki.1000-6753.tces.240627 https://dgjsxb.ces-transaction.com/CN/Y0/V/I/240627

[1] 陈亚鹏, 刘朋矩, 周振宇, 等. 面向业务可靠承载的电力弹性光网络自主协同决策[J]. 电工技术学报, 2023, 38(21): 5821-5831, 5877.
Chen Yapeng, Liu Pengju, Zhou Zhenyu, et al.Autonomous collaborative decision-making for power elastic optical network oriented to service reliable bearing[J]. Transactions of China Electrotechnical Society, 2023, 38(21): 5821-5831, 5877.
[2] 谢可, 郭文静, 祝文军, 等. 面向电力物联网海量终端接入技术研究综述[J]. 电力信息与通信技术, 2021, 19(9): 57-69.
Xie Ke, Guo Wenjing, Zhu Wenjun, et al.Review on access technology of massive terminals of power Internet of Things[J]. Electric Power Information and Communication Technology, 2021, 19(9): 57-69.
[3] 姜云鹏, 任洲洋, 李秋燕, 等. 考虑多灵活性资源协调调度的配电网新能源消纳策略[J]. 电工技术学报, 2022, 37(7): 1820-1835.
Jiang Yunpeng, Ren Zhouyang, Li Qiuyan, et al.An accommodation strategy for renewable energy in distribution network considering coordinated dispatching of multi-flexible resources[J]. Transactions of China Electrotechnical Society, 2022, 37(7): 1820-1835.
[4] 潘玺安, 艾欣, 胡俊杰, 等. 考虑网络安全约束的分布式智能电网边云协同优化调度方法[J/OL]. 电工技术学报, 2024: 1-15[2023-12-25]. https://doi.org/10.19595/j.cnki.1000-6753.tces.231352.
Pan Xian, Ai Xin, Hu Junjie, et al. Network security constrained distributed smart grid edge-cloud collaborative optimization scheduling[J]. Transactions of China Electrotechnical Society, 2024: 1-15[2023-12-25]. https://doi.org/10.19595/j.cnki.1000-6753.tces.231352.
[5] 陈亚鹏, 周振宇, 韩东升, 等. 电力+5G前传网中融合时延敏感网络技术的流量调度方法[J]. 电子学报, 2023, 51(5): 1141-1147.
Chen Yapeng, Zhou Zhenyu, Han Dongsheng, et al.TSN-integrated flow scheduling method in Power+5G fronthaul network[J]. Acta Electronica Sinica, 2023, 51(5): 1141-1147.
[6] 倪利, 吕湛, 沈正, 等. 基于云计算的电力系统突发性数据处理任务调度方法[J]. 自动化与仪器仪表, 2021(8): 56-59.
Ni Li, (Lü/lv/lu/lyu) Zhan, Shen Zheng, et al. Cloud computing based scheduling method for sudden data processing in power system[J]. Automation & Instrumentation, 2021(8): 56-59.
[7] Liao Haijun, Jia Zehan, Zhou Zhenyu, et al.Cloud-edge-end collaboration in air-ground integrated power IoT: a semidistributed learning approach[J]. IEEE Transactions on Industrial Informatics, 2022, 18(11): 8047-8057.
[8] 李鹏, 习伟, 李鹏, 等. 基于边缘计算的配电网数字化转型关键问题分析与展望[J]. 电力系统自动化, 2024, 48(6): 29-41.
Li Peng, Xi Wei, Li Peng, et al.Analysis of key issues and prospect for digital transformation of distribution networks based on edge computing[J]. Automation of Electric Power Systems, 2024, 48(6): 29-41.
[9] 文祥宇, 李帅, 刘文彬, 等. 面向配电网的云边端协同技术研究[J]. 山东电力技术, 2022, 49(7): 8-11.
Wen Xiangyu, Li Shuai, Liu Wenbin, et al.Research on Cloud-edge-user collaboration technology for distribution network[J]. Shandong Electric Power, 2022, 49(7): 8-11.
[10] Kai Caihong, Zhou Hao, Yi Yibo, et al.Collaborative cloud-edge-end task offloading in mobile-edge computing networks with limited communication capability[J]. IEEE Transactions on Cognitive Communications and Networking, 2021, 7(2): 624-634.
[11] 鲁蔚锋, 印文徐, 王菁, 等. 面向车辆边缘计算的任务合作卸载[J]. 工程科学与技术, 2024, 56(1): 89-98.
Lu (Wei|Yu)(Feng), Yin Wenxu, Wang Jing, et al. Task cooperative offloading for vehicle edge computing[J]. Advanced Engineering Sciences, 2024, 56(1): 89-98.
[12] 张俊娜, 鲍想, 陈家伟, 等. 一种联合时延和能耗的依赖性任务卸载方法[J]. 计算机研究与发展, 2023, 60(12): 2770-2782.
Zhang Junna, Bao Xiang, Chen Jiawei, et al.A dependent task offloading method for joint time delay and energy consumption[J]. Journal of Computer Research and Development, 2023, 60(12): 2770-2782.
[13] Wang Zhong, Xue Guangtao, Qian Shiyou, et al.CampEdge: distributed computation offloading strategy under large-scale AP-based edge computing system for IoT applications[J]. IEEE Internet of Things Journal, 2021, 8(8): 6733-6745.
[14] Li Haiyuan, Assis K D R, Yan Shuangyi, et al. DRL-based long-term resource planning for task offloading policies in multiserver edge computing networks[J]. IEEE Transactions on Network and Service Management, 2022, 19(4): 4151-4164.
[15] 陈泽宇, 方志远, 杨瑞鑫, 等. 基于深度强化学习的混合动力汽车能量管理策略[J]. 电工技术学报, 2022, 37(23): 6157-6168.
Chen Zeyu, Fang Zhiyuan, Yang Ruixin, et al.Energy management strategy for hybrid electric vehicle based on the deep reinforcement learning method[J]. Transactions of China Electrotechnical Society, 2022, 37(23): 6157-6168.
[16] Huang Yakun, Qiao Xiuquan, Tang Jian, et al.An integrated cloud-edge-device adaptive deep learning service for cross-platform web[J]. IEEE Transactions on Mobile Computing, 2023, 22(4): 1950-1967.
[17] 麻秀范, 冯晓瑜. 考虑5G网络用电需求及可靠性的变电站双Q规划法[J]. 电工技术学报, 2023, 38(11): 2962-2976.
Ma Xiufan, Feng Xiaoyu.Double Q planning method for substation considering power demand of 5G network and reliability[J]. Transactions of China Electrotechnical Society, 2023, 38(11): 2962-2976.
[18] 邓世权, 叶绪国. 基于深度Q网络的多目标任务卸载算法[J]. 计算机应用, 2022, 42(6): 1668-1674.
Deng Shiquan, Ye Xuguo.Multi-objective task offloading algorithm based on deep Q-network[J]. Journal of Computer Applications, 2022, 42(6): 1668-1674.
[19] 李强, 仪晋辉, 杜婷婷, 等. 移动边缘计算中基于A3C的依赖任务卸载与资源分配[J]. 计算机工程, 2023, 49(6): 42-52.
Li Qiang, Yi Jinhui, Du Tingting, et al.Dependent task offloading and resource allocation based on A3C in mobile edge computing[J]. Computer Engineering, 2023, 49(6): 42-52.
[20] Liao Haijun, Zhou Zhenyu, Zhao Xiongwen, et al.Learning-based queue-aware task offloading and resource allocation for space-air-ground-integrated power IoT[J]. IEEE Internet of Things Journal, 2021, 8(7): 5250-5263.
[21] Guo Mian, Guan Quansheng, Chen Weiqi, et al.Delay-optimal scheduling of VMs in a queueing cloud computing system with heterogeneous workloads[J]. IEEE Transactions on Services Computing, 2022, 15(1): 110-123.
[22] Ding Ming, López-Pérez D, Chen Youjia, et al.Ultra-dense networks: a holistic analysis of multi-piece path loss, antenna heights, finite users and BS idle modes[J]. IEEE Transactions on Mobile Computing, 2021, 20(4): 1702-1713.
[23] 周振宇, 陈亚鹏, 潘超, 等. 面向智能电力巡检的高可靠低时延移动边缘计算技术[J]. 高电压技术, 2020, 46(6): 1895-1902.
Zhou Zhenyu, Chen Yapeng, Pan Chao, et al.Ultra-reliable and low-latency mobile edge computing technology for intelligent power inspection[J]. High Voltage Engineering, 2020, 46(6): 1895-1902.