首页|期刊导航|电子科技|强逆光极端环境下基于动态事件相机的车牌识别

强逆光极端环境下基于动态事件相机的车牌识别OA

License Plate Detection and Recognition System Based on Differential Cameras in Strong Backlight Conditions

中文摘要英文摘要

针对强逆光下传统帧式相机动态范围有限导致车牌识别性能下降的问题,文中提出了一种基于动态事件相机的端到端车牌识别方法.动态事件相机具有大于126 dB 的动态范围且仅输出亮度变化以及克服帧式成像失效等优点.利用自主研发的相机采集强逆光车牌事件流,通过累积滑动时间窗口将事件数映射为灰度图像,构建首个面向强逆光车牌识别事件数据集 DVS-PD(Dynamic Vision Sensor Plate Dataset).识别网络采用空间变换网络(Spatial Transformer Network,STN)矫正倾斜车牌,后端使用车牌识别网络(License Plate Recognition Network,LPRNet)输出字符序列.在训练部分引入连接时序分类(Connectionist Temporal Classification,CTC)损失与数据增强,并对比了空时相关滤波(Spatio-Temporal Correlation Filter,STCF)和背景事件抑制(Background Event Suppression,BES)两种去噪预处理.实验结果表明,所提模型在原始、STCF 和 BES 这 3 类事件帧的识别准确率分别为 93.4%、94.5%和 95.1%,优于车牌检测与识别网络(License Plate Detection and Recognition Network,LPDRNet)、循环卷积神经网络(Recurrent Convolutional Neural Network,RCNN)以及序列车牌识别网络(Sequence License Plate Recognition Network,SLPNet),证明了动态事件相机能够有效解决强逆光车牌识别问题.所构建的数据集为后续研究提供了基准,所提模型兼具轻量化与高推理速度,能够有效应对实时车牌检测与识别的场景需求.

In view of the the problems of the decline in license plate recognition performance caused by the lim-ited dynamic range of traditional frame-based cameras under strong backlight,an end-to-end license plate recogni-tion method based on dynamic event cameras is proposed.Dynamic event cameras have the advantages of a dynamic range greater than 126 dB,only outpacing brightness changes,and overcoming the failure of frame-based imaging.The event stream of license plates with strong backlight is collected by using the self-developed camera.The number of events is mapped to grayscale images through the cumulative sliding time window to construct the first event dataset DVS-PD(Dynamic Vision Sensor Plate Dataset)for license plate recognition with strong backlight.The recognition network adopts the STN(Spatial Transformer Network)to correct the tilted license plate,and the back end uses the LPRNet(License Plate Recognition Network)to output the character sequence.In the training section,the CTC(Connectionist Temporal Classification)loss and data augmentation are introduced,and the two denoising preprocess-ing methods of STCF(Spatio-Temporal Correlation Filter)and BES(Background Event Suppression)are compared.The experimental results show that the recognition accuracy rates of the proposed model in the three types of event frames,namely the original,STCF and BES,are 93.4%,94.5%and 95.1%respectively,which are superior to the LPDRNet(License Plate Detection and Recognition Network),the RCNN(Recurrent Convolutional Neural Network)and the SLPNet(Sequence License Plate Recognition Network).It has been proved that the dynamic event camera can effectively solve the problem of license plate recognition in strong backlight.The constructed dataset provides a benchmark for subsequent research.The proposed model combines lightweight and high inference speed,and can ef-fectively meet the scene requirements of real-time license plate detection and recognition.

何国涛;于博宇;李先锐;白宛静;王波

陕西高速电子工程有限公司,陕西 西安 710061西安电子科技大学 人工智能学院,陕西 西安 710071西安电子科技大学 电子工程学院,陕西 西安 710071西安电子科技大学 人工智能学院,陕西 西安 710071西安电子科技大学 电子工程学院,陕西 西安 710071

信息技术与安全科学

车牌识别动态事件相机强逆光事件流数据集字符序列识别

license plate recognitiondynamic event camerastrong backlightevent streamdatasetcharacter sequence recognition

《电子科技》 2026 (7)

81-90,10

陕西省交通运输厅2024年度交通科研项目(24-100K) 2024 Transportation Research Project of Shaanxi Provincial Department of Transportation(24-100K)

10.16180/j.cnki.issn1007-7820.2026.07.011

评论