基于卷积神经网络与时延神经网络加权特征融合的语种识别OA
Language Recognition Based on Weighted Feature Fusion of Convolutional Neural Network and Time-Delay Neural Network
针对传统卷积神经网络(CNN)和时延神经网络(TDNN)在语种识别中识别率不高的问题,提出了一种新的语种识别网络模型.在CNN网络的基础上引入频域注意力机制,并且在卷积层的输出将ReLU激活函数负半轴取绝对值再乘以极小值以避免训练时出现神经元死亡现象.然后在ECAPA-TDNN网络的基础上,在其第一层卷积后引入池化层以去除特征中的冗余信息.最后将构建的FCA-CNN网络与NECAPA-TDNN网络进行加权融合组成融合网络,将提取的语音特征作为融合网络的输入进行分类识别.实验结果表明,融合网络在LibriVox数据集下对语谱图特征的平均识别准确率较CNN网络与TDNN网络提升了 10.96%与 17.12%,验证了融合网络的有效性和识别性能.
Targeting at the low recognition rate of traditional Convolutional Neural Network(CNN)and Time-Delay Neural Network(TDNN)network,a new language recognition network model is proposed.To avoid the phenomenon of neuron death during training.The frequency domain attention mechanism is introduced on the basis of the traditional CNN network and in the output of the convolution layer,the value on the negative axis of the ReLU activation function is taken by an absolute value and multiplied by a minimum con-stant.Then,on the basis of ECAPA-TDNN network,a pooling layer is introduced after the first layer of convolution to remove redundant information in features.Finally,weighted fusion is performed between the constructed FCA-CNN network and NECAPA-TDNN network to form a fusion network,and the extracted speech features are used as the input of the fusion network for classification and recognition.The experimental results show that the average recognition accuracy of the spectrogram features in LibriVox data set is improved by 10.96%and 17.12%compared with CNN and TDNN,which verifies the effectiveness and recognition performance of the fusion network.
黄张衡;龙华;邵玉斌;张洪波;杨璞;张靖南
昆明理工大学信息工程与自动化学院,云南 昆明 650500||民航云南空管分局,云南 昆明 650200昆明理工大学信息工程与自动化学院,云南 昆明 650500昆明理工大学信息工程与自动化学院,云南 昆明 650500民航云南空管分局,云南 昆明 650200民航云南空管分局,云南 昆明 650200云南民族大学教育学院,云南 昆明 650504
语种识别加权融合网络神经网络分类频域注意力
language recognitionweighted fusion networkneural network classificationfrequency domain attention
《传感技术学报》 2026 (3)
561-570,10
评论