首页|期刊导航|量子电子学报|高效轻量化的单光子三维成像方法

高效轻量化的单光子三维成像方法OA

Efficient lightweight single-photon three-dimensional imaging method

中文摘要英文摘要

随着深度学习的发展,单光子成像逐渐成为一个重要且具有挑战性的研究领域,深度学习的引入有助于指导单光子图像的三维(3D)重建.单光子图像是一种稀疏且充满噪声的3D图像,其时间通道中仅包含少量有效信号回波.现有的单光子成像重建架构中,通常通过构建更庞大的主干网络以提升性能,代价是占用更高的显存.因此,设计轻量级且有效的模型,部署到边缘设备上,成为当前相关领域关注的重点之一.本文提出一种轻量级3D图像重建架构,在大幅降低计算量的情况下,取得了与其他方法相近的效果.具体而言,该架构首先利用Swin Transformer网络提取单光子图像的时间域特征,通过该时间预测网络可大幅降低单光子图像的维度,再通过一个密集级联多尺度网络(DCMNet)提取其空间域特征,最终完成对单光子图像的重建.该架构通过自上而下的级联路径和密集连接,改进了解码层之间的互连,以生成高质量的多分辨率深度输出.实验表明,所提架构在显著减少资源占用的同时,仍能取得良好的效果.

With the advancement of deep learning,single-photon imaging has gradually become an important and challenging research direction,and the introduction of deep learning is helpful for the three-dimensional(3D)reconstruction of single-photon images.Generally,single-photon images are sparse,noise-filled 3D images,with only a few valid signal echoes in their time channels.The existing single-photon imaging reconstruction architectures generally improve their performance by establishing larger backbone networks,which comes at the cost of higher GPU memory usage.Therefore,designing a lightweight yet effective model for deployment on edge devices has become one of the current focuses in related fields.This paper proposes a lightweight 3D image reconstruction architecture that achieves comparable results to other methods while significantly reducing computational requirements.Specifically,the architecture first utilizes a Swin Transformer network to extract temporal features of single-photon images,significantly reducing the dimensions of single-photon images through this time prediction network.Then,a densely cascaded multi-scale network(DCMNet)is employed to extract spatial domain features of single-photon images,ultimately completing the reconstruction of single photon images.This architecture improves the interconnection between decoding layers through a top-down cascade pathway and dense connections to generate high-quality multi-resolution depth outputs.Experimental results demonstrate that the proposed architecture can achieve commendable results while significantly reducing resource consumption.

郑杰凯;刘尉悦;刘腾;林泽洪

宁波大学信息科学与工程学院,浙江 宁波 315211宁波大学信息科学与工程学院,浙江 宁波 315211宁波大学信息科学与工程学院,浙江 宁波 315211丽水职业技术学院电子信息学院,浙江 丽水 323000

数理科学

计算机视觉单光子图像三维重建Swin Transformer与密集级联多尺度网络轻量级架构边缘计算

computer visionthree-dimensional reconstruction of single-photon imagesSwin Transformer and dense cascaded multi-scale networklightweight architectureedge computing

《量子电子学报》 2026 (3)

384-393,10

浙江省自然科学基金(LY21F050003,LY23F010003),浙江省"尖兵""领雁"研发攻关计划(2024C01105)

10.3969/j.issn.1007-5461.2026.03.006

评论