后训练量化方法综述(特邀)OA

Post-Training Quantization(PTQ)is an efficient model compression method that converts the parameters of high-precision floating-point models into low-bit integer representations without requiring retraining,using only a small amount of unlabeled calibration data.This method significantly reduces storage and computational overhead while maximizing the retention of the original model's inference accuracy;therefore,it is widely recognized and adopted in both academia and industry.This paper systematically summarizes the progress of research on PTQ from four dimensions:quantization steps,method classification,tool ecosystem,and application advancements.First,a clear framework for the quantization process is constructed,covering steps such as dynamic range statistics,quantization parameter calculation,weight and activation quantization,error optimization,and model generation.Second,a complete classification system for quantization methods is proposed,which includes quantization granularity,bit width,calibration methods,and structure-guided quantization.Third,the tool ecosystem supporting the large-scale application of PTQ is analyzed,and its value in hardware adaptation and engineering deployment is discussed.Finally,this paper summarizes the progress in the integration and application of PTQ methods and highlights practical challenges,particularly those related to cross-modal consistency,extremely low-bit semantic collapse,and hardware adaptation.These challenges not only reveal the limitations of current technologies but also provide important directions for future research.This review provides a reference framework for PTQ methods in academia and industry,thereby facilitating the widespread application of artificial intelligence in resource-constrained scenarios.