首页|期刊导航|深圳大学学报(理工版)|基于朴素贝叶斯集成的正类-无标签学习算法

基于朴素贝叶斯集成的正类-无标签学习算法OA

NBEB-PUL:a naïve Bayesian ensemble-based algorithm for positive and unlabeled learning

中文摘要英文摘要

针对基于集成学习策略处理正类-无标签学习(positive and unlabeled learning,PUL)问题时存在的未能充分考虑正类和无标签样本中噪声对分类器构建影响的缺陷,提出一种包含类别标注和噪声筛选两个阶段的基于朴素贝叶斯集成的正类-无标签学习(naïve Bayesian ensemble-based positive and unlabeled learning,NBEB-PUL)算法.为便于对无标签样本标注不确定性进行显式表示,引入贝叶斯分类器作为基分类器,并结合AdaBoosting的集成策略,构建强分类器Ada-NBC计算无标签数据的标注不确定性,进而基于不确定性较低的可靠正类样本,形成可靠正类样本集和剩余无标签样本集.为弱化噪声样本对二类分类器性能的干扰,使用Ada-NBC分类器对原始数据集进行再分类,生成基于Ada-NBC预测的正类样本集和负类样本集,再与类别标注阶段所得的正集和无标签集进行交集筛选,提取出重合的高置信度样本以形成最终的正负样本集,并从中筛选出噪声样本.在23个选自UCI与KEEL的标准数据集上对NBEB-PUL算法的可行性、合理性及有效性进行验证.结果表明,随着迭代次数的增加,NBEB-PUL算法在训练过程中呈现出收敛的特性,且在正类样本比例分别为0.45、0.40、0.35和0.30的情况下,NBEB-PUL算法在分类精度上总体优于S-EM、Biased-SVM、Modified-PUL、PU-LP、LP-PUL和AdaPU等6种先进PUL算法,取得了最低的精度平均排序值.研究结果证实了NBEB-PUL是一种高效的能够处理正类-无标签学习问题的优化策略.

Existing ensemble-based positive and unlabeled learning(PUL)methods often fail to adequately account for the impact of noise in both positive and unlabeled samples during classifier construction.To address this issue,this paper proposes a naïve Bayesian ensemble-based PUL algorithm(NBEB-PUL),which consists of two stages:label assignment and noise filtering.In the label assignment stage,NBEB-PUL employs naïve Bayesian classifiers as base learners and integrates them using the AdaBoosting ensemble strategy to construct a strong classifier,named Ada-NBC.This strong classifier is then utilized to compute the mean posterior probabilities of a validation set for unlabeled samples,enabling explicit modeling of labeling uncertainty.Based on low-uncertainty predictions a set of reliable positive samples is iteratively identified,along with a residual unlabeled sample set.In the noise filtering stage,NBEB-PUL leverages the ensemble classifier generated in the first stage to reclassify the reliable positive set and the residual unlabeled set,resulting in Ada-NBC-predicted positive and negative sample sets.These sets are then intersected with the first-stage positive and unlabeled sets to extract overlapping high-confidence samples,forming the final positive and negative sample sets.The samples pruned from the dataset during this process are identified as noise.The feasibility,rationality,and effectiveness of NBEB-PUL were validated on 23 benchmark datasets from UCI and KEEL.Experimental results demonstrate that the algorithm exhibits stable convergence during the training process as the number of iterations increases.Moreover,NBEB-PUL outperforms six state-of-the-art PUL algorithms(S-EM,Biased-SVM,Modified-PUL,PU-LP,LP-PUL,and AdaPU)in terms of classification accuracy under varying positive sample proportions of 0.45,0.40,0.35,and 0.30.These results confirm that NBEB-PUL provides an effective and robust solution for positive and unlabeled learning in the presence of noise.

常秀颖;王晓兰;朱涛;何芃;欧桂良;何玉林

沧州职业技术学院华为ICT学院,河北 沧州 061001沧州职业技术学院信息工程系,河北 沧州 061001深圳大学计算机与软件学院,广东 深圳 518060||人工智能与数字经济广东省实验室(深圳),广东 深圳 518107深圳大学计算机与软件学院,广东 深圳 518060人工智能与数字经济广东省实验室(深圳),广东 深圳 518107人工智能与数字经济广东省实验室(深圳),广东 深圳 518107

信息技术与安全科学

知识工程正类-无标签学习标注不确定性后验概率贝叶斯分类器集成学习

knowledge engineeringpositive and unlabeled learninglabeling uncertaintyposterior probabilityBayesian classifierensemble learning

《深圳大学学报(理工版)》 2026 (3)

338-346,9

Natural Science Foundation of Guangdong Province(2023A1515011667)Guangdong Basic and Applied Basic Research Foundation(2023B1515120020)Science and Technology Major Project of Shenzhen(KJZD20230923114809020) 广东省自然科学基金资助项目(2023A1515011667)广东省基础与应用基础研究基金粤深联合基金重点资助项目(2023B1515120020)深圳市科技重大专项资助项目(KJZD20230923114809020)

10.3724/SP.J.1249.2026.03338

评论