论文检索
期刊
全部知识仓储预印本开放期刊机构
高级检索

全景视频中多运动对象检测与跟踪方法OA北大核心CSTPCD

Detection and Tracking Method for Multiple Moving Objects in Panoramic Video

中文摘要英文摘要

全景视频多运动对象检测与跟踪技术的通用解决方案是通过投影变换将360°视频转为二维视频后进行检测和跟踪.然而固定球面投影变换会导致全景视频中存在空间上不连续的投影边界,当运动对象处于投影边界时,常规球面投影方法可能将其切分为多个部分,从而导致该运动对象的漏检或误检.针对该问题,提出了融合等距柱状形投影(equi-rectangular projection,ERP)和立方体投影(cube map projection,CMP)的全景视频多运动对象检测与跟踪方法,利用合适的CMP拼接帧减少ERP两极区域失真并弥补其边界不连续性,解决了处于投影边界和两极扭曲的对象检测问题.进一步,通过感知哈希、球面质心和运动方向等多重特征融合来解决全景视频多运动对象跟踪问题.实验结果表明,提出的方案可以有效减少投影边界不连续导致的误检,且能有效应对遮挡、穿梭帧边界和两极扭曲的对象跟踪问题.

The general solution of detection and tracking technology in panoramic videos is to detect and track moving objects after converting 360°video into two-dimensional video by projection.However,the fixed spherical projection will lead to discontinuous projection boundaries in panoramic videos.When a moving object is at a projection boundary,conventional spherical projection methods may divide the object into multiple parts,resulting in the missed or false detec-tion.A multi-motion object detection and tracking method in panoramic video combining equi-rectangular projection(ERP)and cube map projection(CMP)is proposed.It uses suitable CMP stitching frames to reduce the polar distortion and compensate for the discontinuity of projection boundaries of ERP frames,solving the detection of objects at projection boundaries or polar distortion.Then,multi-motion object tracking is solved by fusing multiple features of perceptual hashing,spherical centroid and motion direction.Experimental results show that the proposed scheme can effectively alleviate the false detection caused by discontinuous projection boundaries and correctly track moving objects with occlusion,frame boundary shuttle or polar distortion.

刘慧彤;王希;刘威;杨鹏

华中科技大学 智能互联网湖北省重点实验室 电子信息与通信学院,武汉 430074

计算机与自动化

全景视频;多运动对象检测与跟踪;等距柱状形投影(ERP);立方体投影(CMP)

panoramic video;multi-motion object detection and tracking;equi-rectangular projection(ERP);cube map projection(CMP)

《计算机工程与应用》 2024 (010)

188-197 / 10

国家自然科学基金(61977064);"教育部-中国移动"联合基金(MCM20200408);湖北省重点研究计划重点课题(2020BAB120);国家重点研发计划(2021YFC3340802);国家自然科学基金青年项目(62001180);中国科协青年人才托举工程(2022QNRC001).

10.3778/j.issn.1002-8331.2212-0371

评论

下载量:0
点击量:0