基于预训练模型的小样本视觉问答研究综述OA
Review of Few-Shot Visual Question Answering Based on Pre-Trained Models
传统视觉问答依赖大量标注样本支撑模型的学习与推理能力,而在小样本条件下表现受限.面对该问题,小样本视觉问答(few-shot visual question answering,FS-VQA)旨在有限监督下实现精准理解与跨模态推理,近年来在医学影像、遥感地理等低资源场景中具有重要的应用前景.然而,跨模态语义偏差、数据分布不匹配以及面对开放环境时的推理泛化能力不足等问题,仍是FS-VQA发展的关键瓶颈.在此背景下,梳理了预训练模型与FS-VQA的关联性核心理论,涵盖了预训练模型的架构机制以及视觉问答与小样本视觉问答的基础定义.从监督构造与分布适配、跨模态一致性与偏差抑制以及开放知识增强与跨任务迁移三个视角,对现有基于预训练模型的FS-VQA方法进行分类与机制分析;汇总典型模型在主流基准与跨域场景上的性能表现,并对比分析各类方法的优缺点与关键技术趋势.进一步,收集整理了FS-VQA在不同领域中典型应用表现,概述其可迁移性与安全性边界.最后,探讨当前小样本视觉问答任务中存在的挑战,并对未来的研究方向进行展望.
Traditional visual question answering(VQA)relies on large-scale annotated data to support model learning and reasoning,and thus performs poorly in low-data regimes.To address this limitation,few-shot visual question answering(FS-VQA)aims to achieve accurate understanding and multimodal reasoning under limited supervision,and has shown important application potential in low-resource scenarios such as medical imaging and remote sensing.However,challenges including cross-modal semantic bias,distribution mismatch,and insufficient generalization in open environments remain key bottlenecks for the development of FS-VQA.In this survey,this paper reviews the core theoretical connections between pre-trained models and FS-VQA,covering representative architectures of pre-trained models as well as funda-mental definitions of VQA and FS-VQA.It then categorizes and analyzes existing pretraining-based FS-VQA methods from three perspectives:supervision construction and distribution adaptation,cross-modal consistency and bias mitiga-tion,and open-knowledge enhancement and cross-task transfer.It summarizes the performance of representative models on mainstream benchmarks and cross-domain settings,and discusses their strengths,limitations,and emerging technical trends.Furthermore,the paper compiles typical applications of FS-VQA across different domains and outlines its transfer-ability and safety boundaries.Finally,it discusses current challenges in FS-VQA and highlights promising directions for future research.
蔚玺;斯琴图;王斯日古楞
内蒙古师范大学 计算机科学技术学院,呼和浩特 010022内蒙古师范大学 计算机科学技术学院,呼和浩特 010022内蒙古师范大学 计算机科学技术学院,呼和浩特 010022
信息技术与安全科学
小样本视觉问答(FS-VQA)预训练模型监督构造跨模态一致性跨任务迁移
few-shot visual question answering(FS-VQA)pre-trained modelssupervision constructioncross-modal consistencycross-task transfer
《计算机工程与应用》 2026 (18)
47-63,17
内蒙古自治区科技计划项目(2025YFDZ0010)内蒙古自治区自然科学基金(2024LHMS06024).
评论