内容自适应量化参数决策的视频感知编码方法OA
Content-Adaptive Quantization Parameter Decision Method for Perceptual Video Coding
以第三代音视频编码标准(Audio video coding standard 3,AVS3)为代表的现代视频编码标准显著提升了压缩效率,但传统优化范式仍高度依赖均方误差(Mean squared error,MSE),而MSE与人眼视觉系统(Human visual system,HVS)的感知特性相关性较弱.近年来,基于知识蒸馏的方法通过生成感知引导的量化参数(Quantization parameter,QP)映射,有效改善了压缩视频的视觉质量.然而,现有方法大多局限于全帧内编码配置,难以直接推广至同时包含帧内与帧间预测的实际视频编码场景.针对上述问题,本文提出一种轻量级的内容自适应QP决策方法.在编码流程之前部署视频内容预分析模块,利用预训练卷积神经网络(Convolutional neural network,CNN)提取输入视频的显著时空特征;随后,决策模型依据这些特征动态确定不同视频片段所适用的编码策略.实验结果表明,所提方法能够针对不同类型的视频内容选择更有效的编码策略.与AVS3基准编码器相比,该方法在多尺度结构相似性(Multi-scale structural similarity,MS-SSIM)评价指标下平均降低 7.11%的 Bjøntegaard Delta码率(Bjøntegaard Delta rate,BD-rate).进一步将其集成至高度优化的AVS3内容感知编码器后,在基本保持峰值信噪比(Peak signal-to-noise ratio,PSNR)性能的同时,MS-SSIM BD-rate相对于共同的AVS3高性能模型(High performance model,HPM)12.0基准进一步改善4.79个百分点.需要指出的是,当前方法采用片段级二值门控,尚不支持帧/块粒度精细调控.
Modern video coding standards such as the audio video coding standard 3(AVS3)have substantially improved compression efficiency,but conventional rate-distortion optimization still relies heavily on signal-fidelity measures such as mean squared error(MSE)and peak signal-to-noise ratio(PSNR),which do not fully reflect the nonlinear characteristics of the human visual system(HVS).Knowledge-distillation-based perceptual coding methods can improve visual quality by transferring bit-allocation knowledge from perceptually optimized learned image compression models to block-level quantization parameter(QP)maps.However,most existing approaches are designed and evaluated under image or all-intra coding configurations.When directly extended to practical video coding with both intra-and inter-frame prediction,a fixed perceptual QP adjustment strategy may produce content-dependent performance fluctuations,especially for sequences with complex textures or strong temporal variation.To address this problem,this paper proposes a lightweight content-adaptive QP decision method for AVS3 video coding.Before actual encoding,a video content pre-analysis module processes the first ten frames of each segment using a pretrained VGG-16 network.Features from shallow,intermediate,and deep layers are pooled and fused to describe fine-grained texture,local structure,and high-level semantics.Temporal variation of the fused features is further summarized into four compact descriptors:Texture,motion,complexity,and motion consistency.A logistic-regression classifier then generates a binary gating signal to determine whether the downstream perceptual optimization module is enabled or bypassed.The classifier is trained on 292 non-overlapping 32-frame segments constructed from standard HEVC test sequences,where the ground-truth label of each segment is determined by the MS-SSIM BD-rate difference between perceptual optimization and the AVS3 anchor under identical coding configurations.Five-fold stratified cross-validation yields an accuracy of 92.3%,a precision of 82.0%,a recall of 93.3%,and an F1 score of 87.3%.Experiments on representative 4K UHD sequences under random-access configuration show that,relative to the AVS3 HPM 12.0 anchor,the proposed method reduces the average BD-rate by 7.11%under multi-scale structural similarity(MS-SSIM)and by 3.39%under PSNR.When integrated into a highly optimized content-aware code(CAC),the average MS-SSIM BD-rate relative to the common HPM anchor improves from −21.45%to −26.24%,corresponding to an additional gain of 4.79 percentage points,while the average PSNR BD-rate improves from − 3.60%to − 7.01%.On a synthetic 64-frame sequence containing abrupt scene changes,the proposed adaptive scheme achieves an 11.82%MS-SSIM BD-rate reduction and a − 0.53%PSNR BD-rate,whereas unconditional perceptual distillation yields a 6.79%MS-SSIM reduction but a 1.71%PSNR increase.These results indicate that the proposed segment-level gating mechanism can retain perceptual coding gains while reducing the risk of objective-quality degradation caused by unconditional perceptual adjustment.The method does not alter the standard bitstream structure and can be integrated as a low-overhead encoder-side decision module in conventional hybrid video coding frameworks.
祁海洋;晏星宇;郑永康;徐龙
宁波大学人工智能学院,宁波 315211宁波大学人工智能学院,宁波 315211宁波大学人工智能学院,宁波 315211宁波大学人工智能学院,宁波 315211
信息技术与安全科学
视频编码第三代音视频编码标准人眼视觉系统深度学习知识蒸馏
video codingaudio video coding standard 3(AVS3)human visual system(HVS)deep learningknowledge distillation
《数据采集与处理》 2026 (5)
1306-1317,12
浙江省"尖兵领雁+X"科技计划项目(2025C01035). The"Pioneer"and"Leading Goose"R&D Program of Zhejiang Province(No.2025C01035).
评论