基于双分支融合网络的动作迁移设计OA
Motion transfer design based on dual-branch fusion network
针对源图像纹理保持与驱动图像姿态精准传递难以兼顾的问题,提出一种双分支融合(dual-branch fusion,DBF)无监督图像生成框架,以实现高质量图像动画动作迁移.该框架采用双流并行的结构,其中,光流对齐分支运用变形技术,维持源图像局部纹理一致性,注意力对齐分支通过全局上下文建模,增强姿态迁移准确性与结构完整性.同时,设计的交叉融合模块基于自适应内容感知策略,动态整合两分支输出,兼顾外观保留与目标动作匹配.在Fashion Video、TaiChi和UvA-Nemo等数据集上的实验结果表明,该框架在多项量化评价指标上优于FOMM和TPS等经典动作迁移模型.具体而言:DBF在UvA-Nemo数据集上的L1重建误差低至0.011;在包含复杂背景与大幅度动作的TaiChi数据集上,代表姿态精度的平均关键点距离和代表结构完整性的关键点缺失率指标均获得显著改善.定量与定性分析结果充分证明,DBF网络能生成时空连贯、视觉逼真的图像序列,在图像结构重建和纹理还原上表现优异.
To address the challenge of balancing source image texture preservation and accurate transfer of driving image pose,this paper proposes a dual-branch fusion(DBF)unsupervised image generation framework to achieve high-quality image animation action transfer.The framework adopts a two-stream parallel architecture.In this architecture,the optical flow alignment branch uses warping techniques to maintain the local texture consistency of the source image,while the attention alignment branch enhances pose transfer accuracy and structural integrity through global context modeling.Meanwhile,a designed cross-fusion module dynamically integrates the outputs of the two branches based on an adaptive content-aware strategy,balancing appearance preservation and target motion matching.Experimental results on datasets such as Fashion Video,TaiChi,and UvA-Nemo show that the proposed method outperforms classic action transfer models such as FOMM and TPS on multiple quantitative evaluation metrics.Specifically,DBF achieves an L1 reconstruction error as low as 0.011 on the UvA-Nemo dataset.Furthermore,On the TaiChi dataset,which contains complex backgrounds and large-scale motions,both the average keypoint distance representing pose accuracy and the missing keypoint rate representing structural integrity are significantly improved.Quantitative and qualitative analysis results fully demonstrate that the DBF network can generate spatiotemporally coherent and visually realistic image sequences,exhibiting excellent performance in image structure reconstruction and texture restoration.
金超群;齐俏
杭州师范大学信息与科学技术学院,浙江杭州杭州师范大学信息与科学技术学院,浙江杭州
信息技术与安全科学
动作迁移人工智能图像生成光流注意力双分支网络
motion transferartificial intelligenceimage generationoptical flowattentiondual-branch fusion network
《杭州师范大学学报(自然科学版)》 2026 (4)
376-384,9
浙江省自然科学基金项目(LQN25F010014)国家自然科学基金项目(62501222,62471170)浙江省重点研发计划项目(2021c03131)
评论