超算系统节点串口缓存启动日志的异常检测研究OA
Anomaly detection in serial port buffer startup logs of supercomputing system nodes
超算系统作为国家科技创新的重要基础设施,广泛应用于科学研究和工程设计等领域,随着超算系统规模不断增大,海量组件的异常和故障成为常态.目前已有多种机器学习与深度学习方法被广泛应用于日志异常检测任务,并取得了良好效果.超算系统的串口缓存启动日志记录了系统启动过程中的关键信息,是调试和运维的重要依据.然而,现有的日志异常检测方法主要针对半结构化日志数据,难以有效处理超算系统中的非结构化串口缓存启动日志.为此,提出了一种半监督日志异常检测方法COMLogNet,该方法由BiLSTM 模块作为核心,结合 VAE与孤立森林堆叠加权构成,其中BiLSTM 模块引入块内外注意力机制,并配合语义分块预处理和词向量-逆文档频率特征提取方法,辅以多行日志异常检测机制,从而实现了高效的日志异常检测.实验结果表明,该方法异常检测性能优于现有主流方法,且时间开销更低,对于提升超算系统的运维效率和可用性等方面具有较大的指导意义和实用价值.
As vital infrastructure for national scientific and technological innovation,supercomputing systems are widely applied in scientific research,engineering design,and other fields.As the scale of supercomputing systems continues to expand,abnormalities and failures in a vast number of components have become the norm.Currently,various machine learning and deep learning methods have been exten-sively employed in log anomaly detection tasks,achieving favorable results.The serial port buffer start-up logs of supercomputing systems record critical information during the system boot process and serve as an important basis for debugging and operation.However,existing log anomaly detection methods primarily target semi-structured log data and struggle to effectively process the unstructured serial port buffer startup logs in supercomputing systems.To address this issue,we propose a semi-supervised log anomaly detection method named COMLogNet.This method is composed of a BiLSTM module as its core,integrating a stacked and weighted structure of variational autoencoder(VAE)and isolation forest.The BiLSTM module incorporates both intra-block and inter-block attention mechanisms,along with semantic block preprocessing and a word vector-inverse document frequency feature extraction method,supplemented by a multi-line log anomaly detection mechanism,thereby achieving efficient log anomaly detection.Experimental results demonstrate that this method outperforms existing mainstream methods in anomaly detection performance while incurring lower time overhead,offering significant guidance and practical value for enhancing the operational maintenance efficiency and availability of supercomputing systems.
沈禹成;袁远;周桐庆;吴宏林
长沙理工大学计算机学院,湖南 长沙 410114国防科技大学计算机学院,湖南 长沙 410073国防科技大学计算机学院,湖南 长沙 410073长沙理工大学计算机学院,湖南 长沙 410114
信息技术与安全科学
超算系统串口缓存启动日志非结构化数据语义分块日志异常检测
supercomputer systemserial port buffer startup logunstructured datasemantic seg-mentationlog anomaly detection
《计算机工程与科学》 2026 (6)
971-982,12
评论