基于后置增强与空频注意力的轻量级操作步骤识别网络OA
Lightweight operation step recognition network based on post enhanced depthwise convolution and spatial-frequency attention
在实践操作教学过程中,使用图像分类对学员的操作结果进行实时识别,根据识别结果为学员提供有效反馈信息,这对提升教学质量并缓解教学资源紧张的现状具有至关重要的作用,轻量级卷积神经网络虽然能够满足识别的实时性要求,但在相似步骤类别上的识别准确率较低.为解决此问题,提出了基于后置增强深度卷积与空频注意力机制的轻量级操作步骤识别网络.通过引入后置增强深度卷积模块,有效提升了网络的非线性表达能力.为了增强特征校准能力,设计了空频联合注意力机制,有效增强并融合重要通道特征与空间维度信息.对骨干网络的初始卷积层与末端卷积层进行了协同优化,减少模型参数量的同时增强特征信息流通.在自建的十类标准操作步骤数据集上进行实验,结果表明,本文方法在两个难分类类别上的准确率分别提升至93.50%和 96.02%,在十个类别上的总体 Top-1 准确率提升至 95.69%,同时训练时长仅 198 s,边缘设备单帧推理延时为4.93 ms,实现了性能与轻量化的最佳平衡,优于其他主流轻量级网络.由于本文网络轻量高效的架构设计和对细微差异的敏感性,易于将其部署在算力有限的设备上,且在其他具有清晰步骤且类间差异不明显的实时识别任务上具有泛化潜力.
In practical operational training,image classification is employed to recognize trainees'operational results in real time.Based on the recognition results,effective feedback can be provided to trainees,which plays a critical role in improving teaching quality and helping mitigate the shortage of teaching resources.Lightweight convolutional neural networks(CNNs)can satisfy real-time recognition requirements.However,recognition accuracy remains low for classes with highly similar operational steps.To address this issue,we propose a lightweight operation step recognition network based on post enhanced depthwise(PED)convolution and spatial-frequency attention mechanism.A post enhanced depthwise convolution module is introduced to effectively improve the nonlinear representation capability of the network,and a spatial-frequency attention(SFA)mechanism is designed to strengthen feature calibration ability,thereby effectively enhancing and integrating important channel features with spatial dimension information.The initial convolution layer and final convolution layer of the backbone network are jointly optimized,reducing the number of model parameters and improving feature information flow.Experiments were conducted on a self-built dataset with ten standard operational step classes.The results show that the proposed method increases the accuracy of two difficult-to-classify classes to 93.50%and 96.02%respectively,the overall Top-1 accuracy in ten classes reaches 95.69%,the training time is only 198 s,and the single-frame inference latency on edge devices is 4.93 ms.These results demonstrate an optimal balance between performance and model lightweightness,superior to other mainstream lightweight networks.The designed network has lightweight and efficient network architecture,and high sensitivity to subtle differences.Therefore,it is appropriate for the devices with limited computing power,and it also has the potential to generalize other real-time recognition tasks with clear steps and indistinct inter-class differences.
范佳;王鹏;李岳;卢煜泰
天津大学 精密测试技术及仪器全国重点实验室,天津 300072天津大学 精密测试技术及仪器全国重点实验室,天津 300072天津大学 精密测试技术及仪器全国重点实验室,天津 300072天津大学 精密测试技术及仪器全国重点实验室,天津 300072
视觉识别图像分类轻量级卷积神经网络后置增强深度卷积空频注意力机制通道重排难分类类别
visual recognitionimage classificationlightweight convolutional neural network(CNN)post enhanced depthwise(PED)convolutionspatial-frequency attention(SFA)mechanismchannel shuffledifficult-to-classify classes
《测试科学与仪器》 2026 (3)
395-406,12
评论