基于对比表示蒸馏的轻量化异常检测方法OA
A lightweight anomaly detection method based on contrastive representation distillation
针对资源受限环境下网络流量异常检测模型的实时部署问题,提出一种基于对比表示蒸馏的轻量化流量异常检测方法.在教师模型中融合局部与全局时序卷积进行多尺度时序特征提取,并引入残差连接与注意力机制以增强特征传递、缓解梯度消失并聚焦关键信息;同时,卷积神经网络与长短期记忆网络混合模型作为分类器进一步整合时空特征并提升分类性能.学生模型在改进的轻量化卷积神经网络架构中融入门控循环单元以强化其时空特征提取能力.最后,通过对比表示蒸馏框架,将教师模型对正负样本的判别性差异有效传递至学生模型.实验结果表明,该方法显著减少了模型参数量,加速了学生模型训练,并通过保持教师模型的判别能力,提升了轻量化模型的检测性能.
To address the challenge of real-time deployment for network traffic anomaly detection models in resource-constrained environments,this paper proposes a lightweight anomaly detection method based on contrastive representation distillation.First,the teacher model integrates local and global temporal convolutions for multi-scale temporal feature extraction,and incorporates residual connections and an at-tention mechanism to enhance feature propagation,mitigate gradient vanishing,and focus on critical in-formation.Simultaneously,a hybrid architecture combining convolutional neural networks(CNN)and long short-term memory networks serves as the classifier to further integrate spatiotemporal features and improve classification performance.Second,the student model employs a streamlined CNN backbone in-tegrated with gated recurrent units to enhance its spatiotemporal feature extraction capability.Finally,within the contrastive representation distillation framework,the discriminative knowledge of the teacher model regarding the differences between positive and negative samples is effectively transferred to the stu-dent model.Experimental results demonstrate that the proposed method significantly reduces the number of model parameters,accelerates the training of the student model,and enhances the detection perfor-mance by preserving the discriminative capability of the teacher model.
许建;张睿;侯锦武;陈燕俐;杨庚
南京邮电大学 计算机学院,江苏 南京 210023||南京邮电大学 大数据安全与智能处理省高校重点实验室,江苏 南京 210023南京邮电大学 计算机学院,江苏 南京 210023南京邮电大学 计算机学院,江苏 南京 210023南京邮电大学 计算机学院,江苏 南京 210023||南京邮电大学 大数据安全与智能处理省高校重点实验室,江苏 南京 210023南京邮电大学 计算机学院,江苏 南京 210023||南京邮电大学 大数据安全与智能处理省高校重点实验室,江苏 南京 210023
信息技术与安全科学
网络流量异常检测对比表示蒸馏多尺度时序特征提取
network trafficanomaly detectioncontrastive representation distillationmulti-scale tem-poral feature extraction
《南京邮电大学学报(自然科学版)》 2026 (3)
23-31,9
国家自然科学基金(62372244)资助项目
评论