转置投影包络线性判别分析OA
Transposed Projection Envelope Linear Discriminant Analysis
线性判别分析(Linear Discriminant Analysis,LDA)是一种运用广泛的特征提取方法,其以Fisher判别准则为指导,增强子空间中异类样本区分性和同类样本紧凑性,提高了降维结果质量,具有成熟、易解释、简单高效等优点,迄今为止仍是学术界和产业界的研究热点之一.诸多学者对LDA进行了改进以进一步提高其性能,然而这些LDA变体方法直接建模在原样本粒度上,只利用了样本自身存在的信息.由DIK(Data-Information-Knowledge)模型表明,人类获取知识有三个层次,即数据层、信息层,以及知识层,数据首先应当被转换为信息,然后再从信息中学习知识.由人类认知机制表明,信息层不仅包含了原始输入自身信息,还包含了与其相似输入间的关联信息.将其类比于LDA降维过程,提取到的特征即为信息,该信息也应当包含相似样本间的关联信息,以提高下游任务性能.且已有相关研究表明,相似样本间存在的关联信息对机器学习模型构建、知识获取至关重要.即现有LDA存在缺陷,其对样本信息的利用不够完备.针对上述问题,本文提出了转置投影包络线性判别分析(Transposed Projection Envelope Linear Discriminant Analysis,TPELDA).首先,通过转置投影将原始样本转换为包含相似样本间关联信息的包络样本,转置投影的核心思想为在样本维度上对一批最近邻样本进行降维,使得降维所得包络样本尽量包含该批样本所含信息;随后基于包络样本利用Fisher判别准则学习降维子空间;同时引入分布差异惩罚项确保降维子空间对原始样本的适配性;最后通过联合优化,该方法在考虑相似样本间关联信息的基础上使得投影到子空间中的样本具有更好的判别特征,即该特征同时代表了样本自身信息以及相似样本间存在的关联信息.实验结果表明,TPELDA在给定的多个数据集上相比相关对比方法性能更优,提升范围在2.25%至13.19%之间.此外,结合其他实验结果,表明了本文方法的有效性.
Linear discriminant analysis(LDA)is a widely used feature extraction method guided by Fisher's discrimi-nant criterion.It enhances the separability of dissimilar samples and the compactness of similar samples within the sub-space,thereby improving the quality of dimensionality reduction results.With its mature,interpretable,simple,and efficient advantages,it remains one of the research hotspots in both academia and industry to date.Numerous scholars have refined LDA to further enhance its performance.However,these LDA variants model directly at the original sample granularity,uti-lizing only the information inherent within the samples themselves.The data-information-knowledge(DIK)model indicates that human knowledge acquisition occurs across three levels:data,information,and knowledge.Data must first be trans-formed into information,from which knowledge is then learned.Human cognitive mechanisms reveal that the information layer encompasses not only the inherent properties of raw inputs but also correlation information among similar inputs.Analogously,in LDA's dimensionality reduction process,extracted features represent information that should also incorpo-rate correlation information among similar samples to enhance downstream task performance.Furthermore,existing re-search demonstrates that the correlation information between similar samples is crucial for machine learning model con-struction and knowledge acquisition.This indicates that existing LDA has limitations,as it does not fully utilize sample in-formation.To address these issues,this paper proposes transposed projection envelope linear discriminant analysis(TPEL-DA).First,transposed projection transforms original samples into envelope samples that encapsulate correlation informa-tion among similar samples.The core idea of transposed projection is to reduce the dimensionality of a batch of nearest neighbor samples along the sample dimension,ensuring the resulting envelope sample retain as much information as possi-ble from the original batch.Subsequently,Fisher's discriminant criterion is employed to learn a reduced-dimension sub-space based on these envelope samples.A distribution-difference penalty term is introduced to ensure the reduced sub-space's adaptability to the original samples.Finally,through joint optimization,this method enhances the discriminative fea-tures of samples projected into the subspace by incorporating the correlation information among similar samples.Thus,the resulting features simultaneously represent both the intrinsic information of individual samples and the correlation informa-tion among similar samples.Experimental results demonstrate that TPELDA outperforms relevant comparison methods across multiple datasets,achieving performance improvements ranging from 2.25%to 13.19%.Furthermore,combined with other experimental findings,the effectiveness of the proposed method is confirmed.
李勇明;赵文强;李帆;张小恒;王品
重庆大学微电子与通信工程学院,重庆 400044重庆大学微电子与通信工程学院,重庆 400044重庆交通大学信息科学与工程学院,重庆 400074重庆大学微电子与通信工程学院,重庆 400044重庆大学微电子与通信工程学院,重庆 400044
信息技术与安全科学
线性判别分析降维关联信息分布差异包络学习特征提取
linear discriminant analysisdimensionality reductioncorrelation informationdistribution discrepancyenvelope learningfeature extraction
《电子学报》 2026 (1)
32-49,18
国家自然科学基金(No.62201106) National Natural Science Foundation of China(No.62201106)
评论