首页|期刊导航|山西大学学报(自然科学版)|缓解多维缩放方法中的随机一致性

缓解多维缩放方法中的随机一致性OA

Mitigating Random Consistency in Multidimensional Scaling Methods

中文摘要英文摘要

在机器学习领域中,样本随机性及随机一致性现象广泛存在于分类、聚类等任务中.当样本有限时,由于样本随机性的存在,样本协方差矩阵的特征值分解可能会具有随机一致性,使用样本特征值与特征向量来估计总体特征值与特征向量时会存在误差.类似地,多维缩放(Multidimensional Scaling,MDS)方法中涉及内积矩阵B的特征值分解,结果也可能具有随机一致性,最后得到的样本低维坐标可能会存在误差,导致模型性能下降.为了提高模型的估计准确度和算法的稳定性,聚焦于研究MDS内积矩阵B的特征值分解中的随机一致性问题,并引入平均思想,使用平均特征向量表示总体特征向量.为了更好地拟合数据真实分布,首先对数据进行多次均匀抽样,其次分析在协方差分解过程中缓解随机一致性的意义及必要性,最后提出缓解随机一致性的多维缩放方法(Expecta-tion-based Multiple Dimensional Scaling,EMDS).在6个公开UCI数据集上进行分类实验验证,实验结果表明,相比于原始MDS方法,EMDS降维后的数据具有更高的分类准确率.

In the field of machine learning,the phenomena of sample randomness and random consistency are widely encountered in tasks such as classification and clustering.When the samples are limited,due to the existence of sample randomness,the eigenvalue decomposition of the sample covariance matrix may have random consistency,and there will be an error when using the sample ei-genvalues and eigenvectors to estimate the overall eigenvalues and eigenvectors.Similarly,the multiple dimensional scaling(MDS)method involves the eigenvalue decomposition of the inner product matrix B.The results may also have random consistency,and the final low-dimensional sample coordinates obtained may have errors,resulting in a degradation of the model performance.In order to improve the estimation accuracy of the model and the stability of the algorithm,this paper focuses on investigating the random con-sistency problem in the eigenvalue decomposition of the inner product matrix B of the MDS method,and introducing the averaging idea,using the average eigenvectors to represent the overall eigenvectors.In order to better fit the true distribution of the data,first,the data are sampled multiple times;second,the significance and necessity of mitigating the random consistency during the covari-ance decomposition are analyzed;and finally,the Expectation-based Multiple Dimensional Scaling(EMDS)is proposed to mitigate the random consistency.The classification experiments are validated on six public UCI datasets,and the experimental results show that the EMDS dimensionality reduction has a higher accuracy rate compared to the original MDS method.

钱宇华;杨瑜;王婕婷

山西大学 大数据科学与产业研究院,山西 太原 030006||山西大学 计算智能与中文信息处理教育部重点实验室,山西 太原 030006山西大学 大数据科学与产业研究院,山西 太原 030006山西大学 大数据科学与产业研究院,山西 太原 030006

信息技术与安全科学

随机一致性多维缩放分类

random consistencymultidimensional scalingclassification

《山西大学学报(自然科学版)》 2026 (1)

92-99,8

国家自然科学基金青年基金(6210613262306170)山西省科技重大专项(202201020101006)山西省基础研究计划(20210302124271202103021223026)山西省科技创新人才团队专项资助(202304051001001)

10.13451/j.sxu.ns.2024057

评论