基于知识蒸馏的开放世界场景图生成算法OA
Open-world Scene Graph Generation Algorithm Based on Knowledge Distillation
开放世界场景图生成领域普遍存在模型网络复杂度高、参数量过大的问题,导致计算资源消耗显著且实际部署困难.为此,基于双阶段知识蒸馏训练框架,提出轻量化开放世界场景图生成(Lightweight Open-World Scene Graph Generation,LO-SGG)模型,通过特征蒸馏机制将教师模型的多层次表征能力迁移至轻量化学生模型,在降低网络参数量的同时保留深度特征提取能力;构建多任务协同学习范式,联合优化目标检测与关系预测任务.实验结果表明,LO-SGG在保持开放世界泛化能力的同时,相比传统非开放世界模型召回率提升6%;将参数量压缩至复杂架构模型的10%,平均精度仅降低2个百分点;整体性能较经典基准方法提高6%~19%.
Open-world scene graph generation is currently hindered by the intricacy of net-work structures and the excessively large parameter sizes.Consequently,significant com-putational resources are consumed,hindering practical deployment.Therefore,a light-weight open-world scene graph generation(LO-SGG)model was proposed based on a two-stage knowledge distillation framework.Multilevel representations from a teacher model were transferred to a lightweight student model through feature distillation.Thus,the network parameters were reduced,while the deep feature extraction capabilities were pre-served.A multitask collaborative learning paradigm was established.The object detection and relation prediction tasks were jointly optimized.The experimental results demonstrate that LO-SGG maintains open-world generalization capability and achieves a 6%higher re-call than traditional closed-world models.The parameter quantity was reduced to 10%of the complex architectures,with only a 2%decrease in mean precision.The overall per-formance surpasses that of classical benchmark methods by 6%to 19%.
顾非凡;宋世淼;葛家尚;杨杰
青岛大学机电工程学院,青岛 266071青岛大学机电工程学院,青岛 266071青岛大学机电工程学院,青岛 266071青岛大学机电工程学院,青岛 266071
信息技术与安全科学
场景图生成知识蒸馏轻量化模型深度学习开放世界
scene graph generationknowledge distillationlightweight modeldeep learn-ingopen world
《青岛大学学报(自然科学版)》 2026 (1)
28-34,7
山东省自然科学基金(批准号:ZR2021MF025)资助.
评论