基于多相机阵列型仿生复眼的图像拼接方法OA
Image Stitching Method Based on Multi-Camera Array Bionic Compound Eye
随着自动驾驶、安防监控和虚拟现实技术的快速发展,为了获得更广的视觉感知范围,大视场成像系统的需求日益增长.受自然界昆虫复眼启发,设计了一种基于多相机阵列型仿生复眼的成像系统,该系统由8个相机组成,采用球形圆环排列以模拟自然复眼结构,可实现105°×100°的大视场.针对大视场成像的图像拼接过程中易出现的拼接质量较差、拼接重影与色差等问题,提出了一种基于凝聚型层次聚类(Agglomerative Hierarchical Clustering,AHC)引导的由粗到精图像拼接方法AHC-LightGlue.首先,利用SuperPoint提取图像的关键点与描述符,在特征匹配之前,引入AHC算法构建特征点的拓扑结构,在簇级别进行粗匹配以锁定对应区域;随后,在对应区域内调用LightGlue进行精细匹配,解决误匹配率高、拼接错位的问题;之后,通过边缘化采样一致性算法计算单应性矩阵;最后,通过提出的自适应加权融合方法实现参考图像与目标图像间的自然过渡,在亮度差异较大的情况下也能达到更好的融合效果,减少大范围色差的问题,进一步提升图像拼接效果.实验表明,所提算法在图像质量和拼接精度方面均得到了提升,并且能够有效地减少图像拼接中的颜色差异,从而产生更平滑自然的拼接图像,相较传统方法具有更强的鲁棒性与自适应性.
With the rapid advancement of autonomous driving,security surveillance,and virtual reality technologies,the demand for wide-field-of-view imaging systems continues to grow to achieve broader visual perception ranges.Inspired by the compound eyes of insects in nature,a bionic compound eye imag-ing system is designed based on a multi-camera array.Comprising eight cameras arranged in a spherical ring to mimic the natural compound eye structure,a wide field of view of 105°×100° is achieved in this system.To address common issues in wide-field image stitching,such as poor quality,ghosting,and chromatic aberration,a coarse-to-fine image stitching method guided by agglomerative hierarchical cluster-ing,named AHC-LightGlue,is proposed.Firstly,key points and descriptors are extracted from the images using SuperPoint.Before feature matching,the topological structure of feature points is con-structed by the agglomerative hierarchical clustering algorithm.Coarse matching is performed at the clus-ter level to lock corresponding regions,followed by fine matching within these regions using LightGlue to address high mismatch rates and misalignment issues.Subsequently,the homography matrix is calculated by marginalizing sample consensus.Finally,a natural transition between the reference and target images is obtained by the proposed adaptive weighting fusion method.In this approach,superior fusion results are delivered even under significant brightness differences,large-scale color discrepancies are reduced,and image stitching quality is further enhanced.Experiments demonstrate that both image quality and stitching accuracy are improved by the proposed algorithm and color discrepancies are effectively reduced in image stitching to form smoother and more natural stitched images.Compared to traditional methods,the image stitching method based on a multi-camera array bionic compound eye has great robustness and adaptability.
田科;沈寅松;刘晓晨;王晨光;赵慧俊;申冲
中北大学 仪器与电子学院,山西 太原 030051中北大学 机电工程学院,山西 太原 030051中北大学 仪器与电子学院,山西 太原 030051中北大学 信息与通信工程学院,山西 太原 030051中北大学 电气与控制工程学院,山西 太原 030051中北大学 仪器与电子学院,山西 太原 030051
信息技术与安全科学
仿生复眼大视场图像匹配图像融合
bionic compound eyewide field of viewimage matchingimage fusion
《测试技术学报》 2026 (4)
435-448,14
国家自然科学基金资助项目(62503437,62503438)山西省重点研发计划资助项目(202202020101002)
评论