自动驾驶地图端到端生成技术综述OA
End-to-end autonomous driving map generation:a survey
自动驾驶地图是支撑智能汽车安全运行的关键基础设施,尤其在道路形态复杂、路况变化频繁的国内城市道路场景,其对系统安全性和稳定性的作用更为重要.长期以来,地图生产主要依赖专业采集和人工标注,普遍受制于高成本、低效率和长更新周期,难以满足自动驾驶地图大规模覆盖和持续更新的需求.在这一背景下,端到端生成逐渐成为该领域的重要演进方向.围绕这一方向,该文从传统多阶段制图的局限出发,梳理自动驾驶地图生成技术的主要发展脉络,比较不同端到端方法在建模思路和实现路径上的差异,并进一步讨论大模型及视觉语言模型带来的新可能及其现实约束.在此基础上,该文对当前尚未解决的关键问题和后续技术演进趋势进行归纳和讨论.
[Significance]Autonomous driving maps are essential for the safe operation of intelligent vehicles,especially on Chinese urban roads,where road structures are complex and traffic conditions change frequently.For a long time,map production has relied on specialized surveying and extensive manual annotation,resulting in high costs,low efficiency,and long update cycles,making large-scale coverage and continuous updating difficult to sustain.Under these conditions,end-to-end autonomous driving map generation has gradually become an important direction in this field.Its fundamental goal is to infer structured map outputs more directly from sensor observations,thereby reducing dependence on complex intermediate procedures and intensive manual intervention.With the continued development of deep learning,the two core tasks of autonomous driving map generation-lane network generation and lane topology prediction-have both shifted toward end-to-end approaches.Concurrently,industrial end-to-end systems have been developed for city-scale map production and updating,while large models,vision-language models,and agent-based systems have further expanded the research space in this area.Nevertheless,several challenges remain unresolved,including generalization in complex scenes,dynamic change detection,interpretability,and consistency in multi-vehicle collaboration.Therefore,it is important to systematically review existing research to provide clearer guidance for the future development of this field.[Progress]For lane network generation,the technical route has evolved from early convolutional neural network(CNN)-based methods to Transformer-based and hybrid architectures.CNN-based methods were widely adopted at an early stage due to their mature operators,stable training,and low deployment cost.They are effective in modeling local geometry;however,their ability to preserve long-range structural consistency becomes more limited in complex scenes.Transformer-based methods later emerged as a major direction because query-based decoding is well suited for structured instance prediction and global relation modeling.Subsequent studies further expanded this line of work to include geometric constraints,map element representation,prior-guided prediction,and temporal consistency in online mapping.Hybrid architectures combine convolutional feature extraction,Transformer-based reasoning,graph modules,and temporal memory,enabling local geometric precision,topological consistency,and engineering feasibility to be addressed within a unified framework.A similar shift can be observed in lane topology prediction.Early methods mainly relied on local connection inference,whereas later studies increasingly treated topology as a structured prediction problem involving order,connectivity,and global consistency.Transformer-based methods strengthened long-range dependency modeling and gradually incorporated geometry,order,connectivity,and generation into a more unified framework.In contrast,graph neural network-based methods explicitly represent node relationships,edge constraints,and multi-scale connectivity patterns through graph structure.Hybrid methods further combine segmentation,sequence modeling,graph reasoning,and redundant supervision to improve robustness in complex road scenes.The main challenge is no longer limited to recovering local geometric shapes,but increasingly lies in maintaining structural consistency when map elements,topological relations,temporal information,and prior knowledge are considered together.Beyond these academic methods,industrial practice has also developed end-to-end map generation systems for large-scale urban deployment,aiming to improve automation,reduce production costs,and shorten update latency.Related studies also cover online high-definition map construction and pseudo-label learning under weak or missing annotations.Meanwhile,large models and vision-language models have gradually entered this line of research.Their potential in map generation has attracted increasing attention;however,their practical use is still constrained by data quality,structural priors,engineering controllability,and the requirements of real production environments.[Conclusions and Prospects]Overall,end-to-end autonomous driving map generation is reshaping the conventional map construction paradigm and has shown clear advantages in process simplification,timeliness,and structured prediction.With the introduction of large models,vision-language models,and agent-based systems,map generation may gradually move beyond geometric construction toward a stage that also involves semantic understanding and human-machine interaction.Further progress in this direction will depend not only on model capability but also on the establishment of stable data pipelines,quality control mechanisms,and closed-loop engineering workflows,thereby supporting the large-scale and stable deployment of autonomous driving systems.
夏德国;杨蒙蒙;杨殿阁
清华大学车辆与运载学院,北京 100084||百度时代网络技术(北京)有限公司,北京 100085清华大学车辆与运载学院,北京 100084||清华大学智能绿色车辆与交通全国重点实验室,北京 100084清华大学车辆与运载学院,北京 100084||清华大学智能绿色车辆与交通全国重点实验室,北京 100084
天文与地球科学
自动驾驶地图端到端地图生成工业级方案视觉语言模型
autonomous driving mapend-to-end map generationindustrial-grade solutionvision language model
《清华大学学报(自然科学版)》 2026 (8)
1587-1610,24
国家自然科学基金面上项目(52472449)北京市自然科学基金联合基金项目(L231008、L243008)
评论