多源异构数据高质量数据集构建与关联敏感性分析识别技术研究OA

[Background]In the digital era,multi-source heterogeneous data have experienced explosive growth,and its enormous inherent value has become increasingly prominent.Provincial state grid process over 100 million network access logs daily,covering diverse data types such as nu-merical data,command category data,and alarm text types data.These data are widely distribut-ed in key business scenarios including dispatching automation systems,the Internet of Things,and new energy grid-connected monitoring,containing huge value in supporting intelligent decision-making of power grids,equipment status prediction,and safety risk prevention and control.However,data quality defects and associated sensitivity risks have become prominent bottlenecks restricting the realization of data value.[Methods]To this end,this paper focuses on technologies for constructing high-quality datasets of multi-source heterogeneous data and analyzing and identifying associated sensitivity.In terms of high-quality dataset construc-tion,the MTabGen method based on a diffusion model is proposed,which realizes high-precision imputation of data defects through multi-modal joint optimization.In the aspect of data association sensitivity analysis,the graph convolutional neural network DGDCN is proposed to construct data association graphs and identify sensi-tive association paths.[Results]Experimental verification shows that the MTabGen method is significantly supe-rior to traditional data construction methods in terms of accuracy and completeness indicators;the graph convolu-tional neural network DGDCN comprehensively outperforms traditional machine learning methods in precision,recall,and F1-score.