融合语义流的门控自适应交通场景语义分割算法OA
Gated Adaptive Traffic Scene Semantic Segmentation Algorithm Integrating Semantic Stream
针对现有交通场景语义分割算法难以同时准确分割目标主体和目标边缘,导致小目标易融入到周围背景和纤细条状目标分割不连续等问题,提出一种融合语义流的门控自适应交通场景语义分割算法.构建基于局部与全局上下文的并行互补自适应门控模块,通过自适应融合多头自注意力机制与深度卷积提取的互补特征信息,克服不同类别之间的相似特征编码问题,以增强不同对象之间的判别表示.根据卷积的感受野优势和归纳偏置特性,构建基于深度可分离卷积的轻量级局部特征提取模块,在多个不同尺度上捕获特征图的局部细节信息,以增强网络对小目标的表示能力,同时避免网络结构冗余.构建语义流引导的跨层聚合模块,对齐和聚合下采样操作下的相邻特征图进一步建模全局上下文,并缓解纤细条状目标分割不连续的问题.交通场景数据集Cityscapes和CamVid上的实验结果表明,所提算法能够取得80.16%和84.78%的平均交并比,并能够在精炼目标分割边缘的同时提高小目标和纤细条状目标的分割精度.
Focusing on the existing traffic scene semantic segmentation algorithms being difficult to accurately segment the object body and object edges at the same time,resulting in small objects being easily integrated into the surrounding background and discontinuous segmentation of slender stripes,a gated adaptive traffic scene semantic segmentation algo-rithm with fused semantic streams is proposed.Firstly,a parallel complementary adaptive gating module based on local and global is constructed.The complementary feature information extracted by adaptive fusion of multi-head self-atten-tion mechanism and deep convolution is used to overcome the similar feature encoding problem between different catego-ries and enhance the discriminative representation between different objects.Secondly,taking advantage of the receptive field advantage and inductive bias characteristics of convolution,a lightweight local feature extraction module based on deep separable convolution is constructed to capture local detail features of feature maps at multiple scales to enhance the network's representation ability for small objects while avoiding network structural redundancy.Finally,a semantic flow-guided cross-layer aggregation module is designed to align and aggregate adjacent feature maps under downsampling operations to further model the global context and alleviate the problem of discontinuous segmentation of thin and long objects.Experi-mental results on the traffic scene datasets Cityscapes and CamVid demonstrate that the proposed algorithm can achieve 80.16%and 84.78%mIoU,and can improve the segmentation accuracy of small objects and thin strips while refining the object segmentation edges.
谢新林;段泽云;王荃毅;谢刚
太原科技大学 电子信息工程学院,太原 030024||先进控制与工业智能山西省重点实验室,太原 030024太原科技大学 电子信息工程学院,太原 030024||先进控制与工业智能山西省重点实验室,太原 030024太原科技大学 电子信息工程学院,太原 030024||先进控制与工业智能山西省重点实验室,太原 030024太原科技大学 电子信息工程学院,太原 030024||先进控制与工业智能山西省重点实验室,太原 030024
信息技术与安全科学
语义分割深度学习Transformer卷积神经网络(CNN)交通场景
semantic segmentationdeep learningTransformerconvolutional neural network(CNN)traffic scene
《计算机工程与应用》 2026 (5)
302-313,12
国家自然科学基金(62006169)山西省重点研发计划基金(202202010101005)山西省基础研究计划面上项目(202303021221141)太原市关键核心技术攻关"揭榜挂帅"项目(2024TYJB0133,2024TYJB0137).
评论