首页|期刊导航|大数据|基于隐空间拼接与对比学习的语音匿名方法研究

基于隐空间拼接与对比学习的语音匿名方法研究OA

Research on speaker anonymization method via latent space splicing and contrastive learning

中文摘要英文摘要

随着语音技术的广泛应用,语音隐私保护面临严峻挑战.基于此,提出一种基于隐空间拼接与对比学习的语音匿名方法kLCAnoy++,旨在有效去除说话人身份信息,同时保持语音内容可懂度与自然度.该方法首先利用预训练的WavLM模型提取自监督语音特征;其次,通过k近邻算法在多样化参考音频特征库中匹配目标特征,实现隐空间特征拼接,生成初步匿名语音;最后,引入对比学习机制,以自然拼接为正样本、k近邻拼接为负样本,优化声码器解码过程,提升匿名语音的连贯性与自然度.在VCTK数据集上的实验表明,所提方法显著优于基线方法,可视化分析进一步验证了该方法能有效解耦说话人身份信息.

With the widespread application of speech technology,voice privacy protection faces severe challenges.A speech anonymization method(kLCAnoy++)based on latent space splicing and contrastive learning was proposed,aiming to effectively remove speaker identity information while preserving speech content intelligibility and naturalness.The method first employed the pretrained WavLM model to extract self-supervised speech features.Subsequently,it matched target features in a diverse reference audio feature library using the k-nearest neighbors algorithm,achieving latent space feature splicing to generate preliminary anonymized speech.Finally,a contrastive learning mechanism was introduced,treating natural splicing as positive samples and k-nearest neighbor splicing as negative samples,to optimize the vocoder decoding process and enhance the coherence and naturalness of anonymized speech.Experiments on the VCTK dataset demonstrated that the proposed method significantly outperformed baseline approaches,with visualization analysis further confirming its effectiveness in disentangling speaker identity information.

张旭龙;瞿晓阳;倪晓俊;田晖;王健宗

平安科技(深圳)有限公司,广东 深圳 518000平安科技(深圳)有限公司,广东 深圳 518000中国科学院计算技术研究所,北京 100190华侨大学计算机科学与技术学院,福建 泉州 362021平安科技(深圳)有限公司,广东 深圳 518000

信息技术与安全科学

语音匿名化说话人去标识自监督语音表示隐空间特征拼接对比学习

speech anonymizationspeaker de-identificationself-supervised speech representationslatent space splicingcontrastive learning

《大数据》 2026 (4)

137-146,10

深港联合基金(A类)项目(No.SGDX20240115103359001) The Shenzhen-Hong Kong Joint Funding Project(Category A)(No.SGDX20240115103359001)

10.11959/j.issn.2096-6652.2026059

评论