基于Spark和K-means++的电力数据异常检测OA
Power Data Anomaly Detection Based on Spark and K-means++
随着电网信息水平的逐步提高,电力数据呈现出量化和复杂化的趋势.针对传统电力大数据异常检测方法精度较低、稳定性不佳,在海量数据的场景下出现的计算资源不足,以及Hadoop架构中MapReduce引擎在机器学习这种反复迭代的场景下执行效率低下等问题,提出了基于Spark的并行K-means++算法.通过仿真实验表明,该算法对在电力数据场景下对异常数据的检测有较好效果,能有效提高聚类结果的准确性和收敛性.
With the gradual improvement of power grid information level,power data shows a trend of quantification and com-plexity.Aiming at the problems of low accuracy and poor stability of traditional power big data anomaly detection methods,insuffi-cient computing resources in the context of massive data,and low efficiency of MapReduce engine in Hadoop architecture in the con-text of repeated iterations such as machine learning,a parallel K-means++algorithm based on Spark is proposed.The simulation re-sults show that the algorithm has a good effect on the detection of abnormal data in the power data scenario,and can effectively im-prove the accuracy and convergence of clustering results.
张磊;余粟
上海工程技术大学机械与汽车工程学院 上海 201620上海工程技术大学工程实训中心 上海 201620
信息技术与安全科学
电力负荷SparkK-means++异常检测
power loadSparkK-means++anomaly detection
《计算机与数字工程》 2026 (2)
444-449,6
评论