物联网中面向视频传输的GAN增强型语义通信系统OA
GAN-enhanced Semantic Communication System for Reliable Video Transmission in the Internet of Things
物联网环境中高可靠视频传输对于智能监控、远程操作等关键应用至关重要,然而物理信道噪声与视觉语义噪声的耦合却时常影响视频传输质量.为在兼顾传输可靠性的前提下,有效提升物联网环境中的视频传输质量,提出一种基于生成对抗网络(Generative Adversarial Network,GAN)的多维噪声鲁棒性视频语义通信系统.该系统在深度视频语义通信(Deep Video Semantic Communication,DVSC)系统中引入GAN,结合残差通道注意力模块(Residual Channel Attention Block,RCAB)和多尺度卷积-反卷积结构,提升在复杂噪声干扰下的语义保持与细节重建能力.此外,系统还利用多尺度判别器和谱归一化技术,有效稳定对抗训练、缓解模式崩溃,增强判别器在恶劣信道条件下对视频帧的辨别能力.通过融合像素级保真度、感知相似度及对抗损失,设计多目标优化函数,以协同优化视频重建质量.实验结果表明,与传统方法相比,系统在低信噪比(Signal to Noise Ratios,SNR)及其他多维噪声条件下提高了视频重建质量与鲁棒性,尤其在高噪声环境中,质量提升明显.验证了系统在提升物联网视频通信可靠性上的有效性,为超可靠低时延通信(Ultra-Reliable and Low Latency Communica-tions,URLLC)提供了一种新的解决思路.
High-reliability video transmission in internet of things environments is crucial for critical applications such as intelligent surveillance and remote operations.However,the coupling of physical channel noise and visual semantic noise often affects video transmission quality.To effectively improve video transmission quality in internet of things environments while ensuring transmission reliability,a video semantic communication system robust to multi-dimensional noise based on Generative Adversarial Network(GAN)is proposed.The system integrates GAN into Deep Video Semantic Communication(DVSC)systems,incorporating Residual Channel Attention Block(RCAB)and multi-scale convolution-deconvolution structures to enhance semantic preservation and detail reconstruction capabilities under complex noise interference.Furthermore,it employs multi-scale discriminators and spectral normalization techniques to effectively stabilize adversarial training,mitigate mode collapse,and enhance the discriminator's capability in distinguishing video frames under adverse channel conditions.Finally,a multi-objective optimization function is designed by fusing pixel-level fidelity,perceptual similarity,and adversarial loss to collaboratively optimize video reconstruction quality.Experimental results demonstrate that compared to traditional methods,the proposed system improves video reconstruction quality and robustness under multi-dimensional noise conditions such as low Signal to Noise Ratios(SNR),with particularly significant quality improvements in high-noise environments.The effectiveness of the system in enhancing internet of things video communication reliability is validated,providing a novel solution for Ultra-Reliable and Low Latency Communications(URLLC).
向晨;刘鹏程;吕娇;王潇;王周恺
中国人民解放军61363 部队,陕西 西安 710054中国人民解放军61363 部队,陕西 西安 710054中国人民解放军61363 部队,陕西 西安 710054西安理工大学计算机科学与工程学院,陕西 西安 710048西安理工大学计算机科学与工程学院,陕西 西安 710048||陕西省网络计算与安全技术重点实验室,陕西 西安 710048
信息技术与安全科学
语义通信生成对抗网络残差通道注意力多尺度判别谱归一化物联网
semantic communicationGANresidual channel attentionmulti-scale discriminatorspectral normalizationinternet of things
《无线电工程》 2026 (2)
231-241,11
国家重点研发计划(2024YFF1401303) National Key Research and Development Program of China(2024YFF1401303)
评论