融合时序上下文线索的单流Transformer跟踪算法OA
One-stream Transformer Tracking Algorithm Incorporating Temporal Contextual Clues
单流 Transformer 跟踪框架因其强大的全局建模能力而备受关注.然而,单流 Transformer 跟踪器普遍存在时序上下文信息利用不足的问题,易因历史状态记忆缺失导致跟踪漂移.针对该问题,提出一种融合时序上下文线索的单流Transformer 跟踪算法,以增强复杂场景下的目标表征能力.首先,设计时间建模模块,基于 Transformer 对历史帧序列进行时序建模,提取目标运动轨迹与外观演化特征;其次,构建空间解码模块,将时间线索与目标查询动态融合,生成增强型时空表征;最后,通过预测头实现目标定位与状态更新.实验在 GOT-10K、TrackingNet、LaSOT、NFS、UAV123、TNL2K 六个公开基准数据集上进行了公开比较,在数据集 TrackingNet 中,AUC 得分和精准度为83.5%、82.4%,在所有对比方法中位列第一;在数据集 GOT-10K 中,平均重叠率为72.6%,相比于性能第2 的模型 DyTrack 提高了1.2 百分点;在 LaSOT 数据集中,AUC 得分为69.2%,与目前最优异的模型 DyTrack 相当.实验结果显示,该算法通过显式建模时序上下文信息,显著提升了单流 Transformer 跟踪器的鲁棒性与准确性,验证了时序上下文线索的有效性.
The one-stream Transformer tracking framework has attracted much attention due to its strong global modeling capability.However,one-stream Transformer trackers generally suffer from insufficient utilization of temporal context information,which easily leads to tracking drift due to the loss of historical state memory.To address this issue,we propose a one-stream Transformer tracking al-gorithm that integrates temporal context clues to enhance the target representation capability in complex scenarios.Firstly,a temporal modeling module is designed to perform temporal modeling on historical frame sequences based on Transformer,extracting target motion trajectories and appearance evolution features.Secondly,a spatial decoding module is constructed to dynamically fuse time clues with target queries,generating enhanced spatiotemporal representations.Finally,target localization and state update are realized through the prediction head.The experiment was publicly compared on six benchmark datasets,GOT-10K,TrackingNet,LaSOT,NFS,UAV123,and TNL2K.In the TrackingNet dataset,the AUC score and accuracy were 83.5%and 82.4%,respectively,ranking first among all comparison methods;In the GOT-10K dataset,the average overlap rate is 72.6%,which is 1.2 percentage points higher than that of the performance second model DyTrack;In the LaSOT dataset,the AUC score is69.2%,which is comparable to the current state-of-the-art model DyTrack.The experimental results show that the proposed algorithm significantly improves the robustness and accuracy of the one-stream Transformer tracker by explicitly modeling temporal contextual information,verifying the effectiveness of temporal contextual clues.
孟涛;顾龙雨;高赟
云南大学 信息学院,云南 昆明 650504云南大学 信息学院,云南 昆明 650504云南大学 信息学院,云南 昆明 650504
信息技术与安全科学
目标跟踪视觉Transformer时序上下文时间建模空间解码
object trackingvision Transformertemporal contexttemporal modelingspatial decoding
《计算机技术与发展》 2026 (5)
21-29,9
国家自然科学基金(61802337)
评论