面向无人机平台的CNN-Transformer混合模型训练后量化方法OA
A post-training quantization method for CNN-Transformer hybrid models on UAV platforms
近年,无人机在各类低空生产、服务场景作用愈发重要.由于边缘计算平台的存储、计算资源受限,视觉模型的边端侧运行性能短板成为算法应用于以上场景的技术瓶颈.针对卷积神经网络(CNN)-Transformer混合模型激活值长尾分布导致量化精度严重退化问题,提出高效训练后量化方法.该方法通过激活值噪声补偿(ANC)和自适应难度迁移抑制异常值对量化精度的影响,在提升模型量化精度同时提高其推理速度.实验结果表明:所提方法在典型模型的 8 bit量化场景下,精度损失小于 1%,量化后推理速度最高提升超过 200%.所提方法显著提升了边端侧设备的视觉模型推理性能,为低空无人机平台上的模型部署提供了技术支撑.
In recent years,drones have played increasingly important roles in various low-altitude production and service scenarios.Due to the limited storage and computing resources of edge computing platforms,the deployment performance of vision models becomes a bottleneck for various algorithm applications.The long-tail distribution of activation values in convolutional neural network(CNN)-Transformer hybrid models causes substantial quantization accuracy deterioration,an efficient post-training quantization method is proposed,which this study addresses by suggesting an effective post-training quantization technique.This method uses activation noise compensation(ANC)and adaptive difficulty migration to suppress the impact of outliers on quantization accuracy and improve inference efficiency.According to experimental results,the proposed method achieves less than 1%accuracy loss on typical models under 8-bit quantization,and it improves inference time after quantization by at most 200%.In summary,the proposed method significantly enhances vision model inference performance on edge devices and supports model deployment on low-altitude drone platforms.
赵呈功;胡纪远;杨星宇;陈磊;姜宏旭
北京航空航天大学杭州创新研究院,杭州 310056||北京航空航天大学 软件学院,北京 100191北京航空航天大学杭州创新研究院,杭州 310056||北京航空航天大学 计算机学院,北京 100191内蒙古大学 计算机学院(软件学院),呼和浩特 010021杭州萧山国际机场飞行区中心,杭州 311241北京航空航天大学 计算机学院,北京 100191
航空航天
训练后量化模型压缩推理加速异常值感知边缘计算
post-training quantizationmodel compressioninference accelerationoutlier-awareedge computing
《北京航空航天大学学报》 2026 (9)
3066-3074,9
评论