当代数据库系统评测技术研究进展OA
Survey of testing and benchmarking techniques for modern database systems
随着数据库系统持续向分布式、云原生、混合事务/分析处理、多模态数据管理和智能体访问场景演进,数据库评测的对象、负载形态和质量指标均发生了显著变化.传统评测方法主要面向关系型数据库中的固定查询、稳定负载和单一性能指标,已难以充分刻画现代数据库系统在复杂功能、混合负载、异常环境、生态迁移和安全边界下的真实表现.为此,本文围绕现代数据库系统的关键质量属性,构建了涵盖功能正确性、性能、可用性、兼容性和安全性的评测技术分类框架,并系统梳理各类评测方法的研究进展、适用场景与局限性.进一步地,本文分析大语言模型和智能体驱动的新型数据库访问方式对评测体系提出的新挑战,指出未来数据库评测需要从单点功能测试走向端到端质量验证,从静态基准测试走向动态场景仿真,并进一步覆盖多模查询、智能体接口、结构化结果返回和全链路安全验证等新兴对象.本文旨在为现代数据库系统评测技术的体系化研究与工程实践提供参考.
As database systems continue to evolve toward distributed architectures,cloud-native deployments,hybrid transactional/analytical processing workloads,multimodal data management,and agent-driven access,their evaluation frameworks—including target objects,workload characteristics,and quality metrics—have changed significantly.Conventional evaluation methodologies are primarily designed for relational databases with fixed query patterns,stable workloads,and single-dimensional performance metrics,thus rendering them insufficient for comprehensively characterizing modern database systems operating under complex functionalities,hybrid workloads,abnormal operating conditions,ecosystem migration,and security constraints.Hence,this paper presents a systematic taxonomy of database-evaluation techniques across five key quality dimensions:functional correctness,performance,availability,compatibility,and security.Furthermore,the research progress,application scenarios,and limitations of representative evaluation approaches are reviewed.Subsequently,challenges are introduced by large language models and agent-driven database interactions.We argue that future database evaluation must shift from isolated functionality testing to end-to-end quality validation,and from static,benchmark-based assessment to dynamic scenario simulation.Furthermore,evaluation frameworks must encompass emerging evaluation targets,such as multimodal queries,agent interfaces,structured result generation,and end-to-end security verification.This survey aims to provide a comprehensive reference for academic researchers and engineering practitioners in modern database evaluation.
耿航航;黄煦华;翁思扬;杨洪宇;张蓉
华东师范大学数据科学与工程学院,上海 200062华东师范大学数据科学与工程学院,上海 200062华东师范大学数据科学与工程学院,上海 200062华东师范大学数据科学与工程学院,上海 200062华东师范大学数据科学与工程学院,上海 200062
信息技术与安全科学
数据库系统数据库测试正确性测试
database systemsdatabase testingcorrectness testing
《华东师范大学学报(自然科学版)》 2026 (5)
13-25,13
国家自然科学基金(62072179)
评论