融合最大池化的Conformer中文语音识别OA
Chinese Speech Recognition Using Conformer Fused with Max Pooling
语音识别旨在通过先进的算法与信号处理技术,赋予机器理解人类语音的能力,使得人与机器之间的交流更加便捷、顺畅.目前,大多数端到端语音识别的研究工作主要围绕Conformer模型进行优化.针对Conformer编码器对语音细粒度局部特征提取能力不足的问题,提出一种融合最大池化(MP)的Conformer中文语音识别模型.首先,将编码器卷积模块中门控线性单元的输出在时间维度上进行MP,以提取多帧语音信号对应一个字符的细粒度局部特征.然后,将池化后的特征与逐通道卷积(DWC)提取的粗粒度局部特征以逐元素相加的方式进行融合,以增加语音局部特征的信息量,从而提高Conformer模型的语音识别准确率.最后,在公开的中文数据集Aishell-1上的实验结果表明:采用贪心搜索方式进行解码,所提模型可以将基线模型的字错误率(CER)从5.58%降低至5.32%;采用注意力重打分方式进行解码,所提模型可以将基线模型的CER从5.06%降低至4.92%.
Speech recognition technology enables machines to understand human speech using advanced algorithms and signal processing technologies,thereby making communication between humans and machines more convenient.Most existing studies on end-to-end speech recognition focus on optimizing the Conformer model.The Conformer encoder suffers from the issue of insufficient extraction of fine-grained local speech features.To resolve these issues,this study proposes a Chinese speech recognition method based on Max Pooling(MP).First,the output of the gated linear unit in the convolutional module of the encoder is max-pooled along the time dimension to extract fine-grained local features corresponding to the characteristics of multiple speech signal frames.Second,these pooled features are fused with the coarse-grained local features extracted via Depthwise Convolution(DWC)using the element-wise sum method to increase the amount of information on local speech features and improve the speech recognition accuracy of the Conformer model.The experimental results on the public Chinese dataset Aishell-1 show that the improved model can reduce the Character Error Rate(CER)of the baseline model from 5.58%to 5.32%and from 5.06%to 4.92%by decoding using greedy search and attention rescoring,respectively.
胡从刚;杨立鹏;孙永奇;陈华龙;韩可可
北京交通大学先进轨道交通自主运行全国重点实验室,北京 100044||北京交通大学计算机科学与技术学院,北京 100044中国铁道科学研究院集团有限公司,北京 100081北京交通大学先进轨道交通自主运行全国重点实验室,北京 100044||北京交通大学计算机科学与技术学院,北京 100044中国铁道科学研究院集团有限公司,北京 100081中国铁道科学研究院集团有限公司,北京 100081
信息技术与安全科学
语音识别细粒度局部特征Conformer模型最大池化逐通道卷积
speech recognitionfine-grained local featureConformer modelMax Pooling(MP)Depthwise Convolution(DWC)
《计算机工程》 2026 (1)
105-115,11
中央高校基本科研业务费专项资金(2024JBGP008)新一代人工智能国家科技重大专项(2021ZD0113002).
评论