通信受限的双网络零和博弈分布式在线优化OA
Distributed Online Optimization for Two-network Zero-sum Games Under Communication Constraints
研究双网络零和博弈中的分布式优化问题,其中两个网络代表两个对立的玩家.每个网络由一组具有时变损失函数的智能体组成,智能体通过通信和协作来优化己方网络在博弈中的收益.考虑到现实优化场景中通信资源受限和信息反馈受限两种通信受限情形,设计基于事件触发通信和两点Bandit反馈的分布式在线优化算法,并采用动态纳什均衡遗憾评估算法的性能.在某些假设条件下,建立相对于总博弈次数为次线性的动态纳什均衡遗憾界,从而验证了算法的有效性.此外,将设计的算法拓展为多周期版本并建立次线性的动态纳什均衡遗憾界.最后,通过双线性矩阵博弈的仿真算例进一步验证了所设计的两个算法的性能.
This paper investigates the distributed optimization problem in two-network zero-sum games,where the two networks represent two opposing players.Each network consists of a set of agents with time-varying cost func-tions,and the agents optimize the payoff of their network in the game through communication and collaboration.Considering the two communication constrained situations in real optimization scenarios,namely,limited commu-nication resources and limited information feedback,a distributed online optimization algorithm based on event-triggered communication and two-point Bandit feedback is designed,and the performance of the algorithm is evalu-ated using the dynamic Nash equilibrium regret.Under certain assumptions,a sublinear dynamic Nash equilibrium regret bound relative to the total number of game iterations is established,thereby validating the effectiveness of the algorithm.Additionally,the designed algorithm is extended to a multi-epoch version,and a sublinear dynamic Nash equilibrium regret bound is also established.Finally,a simulation example involving a bilinear matrix game is provided to further verify the performance of the two designed algorithms.
廖岚;于湛;袁德明;张保勇;徐胜元
南京理工大学自动化学院 南京 210094香港浸会大学数学系 香港 999077南京理工大学自动化学院 南京 210094南京理工大学自动化学院 南京 210094南京理工大学自动化学院 南京 210094
零和博弈分布式在线优化动态纳什均衡遗憾Bandit反馈事件触发通信
zero-sum gamesdistributed online optimizationdynamic Nash equilibrium regretBandit feedbackevent-triggered communication
《自动化学报》 2026 (1)
108-120,13
国家自然科学基金(62373190,62273181,62221004,12401123),香港特别行政区研究资助局(HKBU 12301424),江苏省研究生科研与实践创新计划(KYCX24_0673)资助 Supported by National Natural Science Foundation of China(62373190,62273181,62221004,12401123),Research Grants Council of Hong Kong Special Administrative Region(HKBU 12301424),and Postgraduate Research&Practice Innovation Program of Jiangsu Province(KYCX24_0673)
评论