混合数据下基于Tsallis熵的集成因果特征选择算法OA
Ensemble Causal Feature Selection Algorithm Based on Tsallis Entropy for Mixed Data
随着智能技术的发展,数据呈现高维特性,因果特征选择因其高可解释性及鲁棒性得到广泛研究,旨在选择与类变量最具有相关性的特征集,即MB(Markov blanket)集,包括其父母孩子(parents and children,PC)和配偶(spouses,SP)集),以揭示特征间的因果关系.实际应用场景当中,数据往往呈现混合分布,现有因果特征选择算法的研究仅关注单一类型数据,无法直接处理混合数据.针对此类问题,在混合数据场景下提出一种基于Tsallis熵的集成因果特征选择算法HTECFS.在PC学习过程中,利用Tsallis熵不同形态直接计算Tsallis互信息用于度量特征的相关性,以避免数据预处理所造成的潜在信息丢失.在SP学习过程中,通过Tsallis条件互信息检验PC上的SP特征,将新学习到的SP纳入MB集中,提高模型预测的准确率.为获取近似全局的最优MB集,构建多个学习子空间,分别进行独立的MB学习,再进一步引入群优化策略,对学习结果进行融合,提升特征子集的全局性和稳定性.在10个不同类型的数据集上进行大量测试,充分验证了所提算法的有效性.
With the development of intelligent technologies,data has become high-dimensional.Causal feature selection,which is highly interpretable and robust,has been widely studied.It aims to select the feature set most relevant to the class variable,namely its parents and children(PC)and spouses(SP)sets,collectively referred to as the Markov blanket(MB)set,to reveal the causal relationships between features.In practical application scenarios,data often exhibits mixed distri-butions.Most existing causal feature selection algorithms focus only on single-type data and cannot be directly applied to mixed data.To address the above issue,this paper proposes an ensemble causal feature selection algorithm based on Tsallis entropy,called HTECFS,in mixed data scenarios.During the PC learning process,Tsallis mutual information,calculated directly from different forms of Tsallis entropy,is used to measure the correlation between features,avoiding potential information loss caused by data preprocessing.During the SP learning process,Tsallis conditional mutual information is used to test the SP features on the PC,and newly learned SP features are incorporated into the MB set to improve predic-tion accuracy of the model.Furthermore,multiple learning subspaces are constructed for independent MB learning to obtain an approximately globally optimal MB set.Moreover,a group optimization strategy is introduced to fuse the learning results,enhancing the globality and stability of the feature subset.Extensive tests on ten different types of datasets fully validate the effectiveness of the proposed algorithm.
刘子文;郑艺峰;陈新纪;魏葆雅;李国和
闽南师范大学 计算机学院,福建 漳州 363000||数据科学与智能应用福建省高校重点实验室,福建 漳州 363000闽南师范大学 计算机学院,福建 漳州 363000||数据科学与智能应用福建省高校重点实验室,福建 漳州 363000闽南师范大学 计算机学院,福建 漳州 363000||数据科学与智能应用福建省高校重点实验室,福建 漳州 363000闽南师范大学 计算机学院,福建 漳州 363000||数据科学与智能应用福建省高校重点实验室,福建 漳州 363000中国石油大学(北京)克拉玛依校区 新疆油气智能勘探与开发重点实验室,新疆 克拉玛依 834000
信息技术与安全科学
特征选择因果关系混合数据群优化策略Tsallis熵
feature selectioncausal relationshipmixed datagroup optimization strategyTsallis entropy
《计算机工程与应用》 2026 (12)
166-181,16
国家自然科学基金面上项目(62376114)福建省自然科学基金面上项目(2026J001984)漳州市自然科学基金(ZZ2024J20)中国石油大学(北京)克拉玛依校区科研启动基金(XQZX20240032)克拉玛依市科技计划项目(2020CGZH0009)福建省教育厅科技项目中青年重点项目(JZ230032)闽南师范大学校级研究生教学改革项目(YJG202416).
评论