面向通感融合的结构化生成式无线图像传输框架与关键技术OA
Structured Generative Wireless Image Transmission Framework for Integrated Sensing and Communication
随着无线通信向智能化与通感融合演进,如何在受限带宽和不可靠信道条件下实现高效、鲁棒的图像传输,成为智能无线网络中的关键问题.然而,现有的无线图像传输方案多侧重于图像视觉质量的提升,通常缺乏对源图像内容的主动感知与结构化理解(例如目标的空间一致性与显著性),难以在低码率传输和信道扰动下保持目标空间布局、显著区域和高层语义的一致性.针对上述问题,提出一种面向通感融合的结构化生成式无线图像传输框架.在发送端,对感知图像进行显著性检测,提取能够表征场景空间布局的显著性图作为稀疏感知先验;随后,在该结构感知先验的约束下,利用多模态大语言模型将图像转换为结构感知的描述性文本,实现语义与感知特征的结构化联合表征.在通信传输阶段,针对不同模态信息的重要性和冗余特征,采用分模态联合信源信道编码实现低码率、抗噪声的可靠传输,其中显著性先验用于保留关键空间结构,文本语义用于传递高层内容信息.在接收端,重构过程被建模为结构化条件引导的生成工作流,利用接收到的感知先验作为显式约束引导高质量图像合成.仿真结果表明,所提出的结构化生成式传输框架在语义保真度和视觉感知质量方面均显著优于现有方法,充分证明了通感融合与结构化引导在资源受限无线图像通信中的优越性.
As wireless communications evolve towards intelligence and integrated sensing and communication(ISAC),realizing efficient and robust image transmission under limited bandwidth and unreliable channel conditions has become a critical challenge in intelligent wireless networks.However,existing wireless image transmission schemes primarily focus on enhancing visual quality and often lack active sensing and structured understanding of the source image content,such as the spatial consistency and saliency of targets,making it difficult to preserve the spatial layout of targets,salient regions,and high-level semantic consistency under low code-rate transmission and channel disturbances.To address these issues,this paper proposes a structured generative wireless image transmission framework oriented towards ISAC.At the transmitter,a sensing module performs saliency detection to extract a saliency map that characterizes the spatial layout of the scenario,serving as a sparse sensing prior.Subsequently,constrained by this structural sensing prior,a multimodal large language model(MLLM)is utilized to convert the image into structure-aware descriptive text,achieving a structured joint representation of semantics and sensing features.During the transmission phase,considering the importance and redundant characteristics of different modalities,modality-separated joint source-channel coding is employed to achieve low code-rate and anti-noise reliable transmission,where the saliency prior preserves key spatial structures and the text semantics convey high-level content information.At the receiver,the reconstruction process is modeled as a structured condition-guided generative workflow,utilizing the received sensing prior as an explicit constraint to guide high-quality image synthesis.Simulation results demonstrate that the proposed structured generative transmission framework significantly outperforms existing methods in terms of both semantic fidelity and visual perceptual quality,fully validating the superiority of ISAC and structured guidance in resource-constrained wireless image communications.
王朔遥;叶凯浪;毕宿志;钱丽萍
深圳大学电子与信息工程学院,广东 深圳 518000深圳大学电子与信息工程学院,广东 深圳 518000深圳大学电子与信息工程学院,广东 深圳 518000中山大学海洋工程与技术学院,广东珠海 519040
信息技术与安全科学
无线图像通信多模态大语言模型联合信源信道编码工作流语义通信
wireless image communicationmulti-modal large language modeljoint source and channel codingsemantic communication
《移动通信》 2026 (6)
33-42,10
国家自然科学基金项目"基于局部重传和自适码长的实时视频语义通信方法研究"(62571336)广东省基础与应用基础研究基金项目"面向二维与全景视频协同传输的边缘计算与码率自适应研究"(2025A1515010249)深大2035计划项目"面向实时视频通信的语义信息失真度量与信源网络信道联合编码研究"(2024C010)广东省科学技术协会青年科技人才培育计划(SKXRC2025232)
评论