基于类原型网络及动态语义注意力的小样本语义边缘检测OA
Class-Prototype Network and Dynamic Semantic Attention Module for Few-Shot Semantic Edge Detection
准确的语义边缘信息对于物体重建、图像生成和医学成像等机器视觉领域至关重要.然而,现存的基于深度学习的语义边缘检测方法需要大量标注数据去训练网络模型,获得大量标签样本的成本非常昂贵,这给语义边缘检测带来瓶颈.为了克服这种限制,提出一种基于类原型网络及动态语义注意力的小样本语义边缘检测方法DSAPNet.该方法利用元学习训练策略,仅使用少量标注样本来定位新类别的语义边缘.在所提网络中构建了一种基于类原型的小规模语义分割器,实现了在模型结构的不同阶段为语义边缘检测器提供多尺度语义信息.设计了动态语义注意力模块,该模块利用生成多尺度空间注意力图来突出语义上有意义的区域,并使解码器模块集中在该区域,有效地补充了边缘缺失的语义信息.构建了感受野增强模块和上下文信息融合模块,提升了编码路径侧边输出特征的感受野以及融合了它们的上下文信息.在两个小样本语义边缘检测数据集(FSE-1000和SBD-5i)上的实验表明,所提出的DSAPNet在N-way K-shot小样本语义边缘检测任务中具有显著效果.
Accurate semantic edge information is crucial for machine vision applications such as object reconstruction,image generation,and medical imaging.However,existing deep learning-based semantic edge detection methods require a large amount of annotated data to train the network model,and the cost of obtaining a sufficient number of labeled samples is prohibitively high.To overcome this limitation,this paper proposes a few-shot semantic edge detection method based on class-prototype network and dynamic semantic attention,named DSAPNet(dynamic semantic attention and prototype network).It employs a meta-learning training strategy to locate semantic edges of novel categories using only a few annotated samples.The proposed network incorporates a class-prototype-based small-scale semantic segmenter,which provides multi-scale semantic information to the semantic edge detector at different stages of the network architecture.A dynamic semantic attention module is designed,which generates multi-scale spatial attention maps to highlight semantically meaningful regions and focuses the decoder module on those regions,effectively supplementing missing semantic information at the edges.A receptive field enhancement block and a context information fusion module are constructed,improving the receptive field of the output features in the encoding path and integrating their contextual information.Experiments on two few-shot semantic edge detection datasets,i.e.,FSE-1000 and SBD-5i,reveal the effectiveness of the proposed DSAPNet in the N-way K-shot few-shot semantic edge detection task.
鲍士水;高歌;葛斌;许光宇
安徽理工大学 计算机科学与工程学院,安徽 淮南 232001安徽理工大学 计算机科学与工程学院,安徽 淮南 232001安徽理工大学 计算机科学与工程学院,安徽 淮南 232001安徽理工大学 计算机科学与工程学院,安徽 淮南 232001
信息技术与安全科学
元学习小样本学习语义边缘检测类原型网络
meta-learningfew-shot learningsemantic edge detectionclass-prototype network
《计算机科学与探索》 2026 (9)
2678-2689,12
安徽理工大学引进人才科研启动基金(2024yjrc38)国家自然科学基金(61471004). This work was supported by the Scientific Research Launch Fund for Introduced Talents of Anhui University of Science and Technology(2024yjrc38),and the National Natural Science Foundation of China(61471004).
评论