首页|期刊导航|华东师范大学学报(自然科学版)|基于大小模型协同优化的表格数据准备工作流生成方法

基于大小模型协同优化的表格数据准备工作流生成方法OA

Collaborative optimization of large and small models for tabular data-preparation pipeline generation

中文摘要英文摘要

随着大数据与人工智能的发展,越来越多的行业用户开始借助机器学习进行数据分析.本文聚焦于机器学习场景下的数据准备问题,旨在针对给定的机器学习任务(包括表格数据集、训练目标和模型配置),自动构建高质量数据准备工作流.现有工作通常基于深度神经网络模型,这类方法需要预先定义一个有限的数据准备操作空间,难以满足定制化需求.随着大语言模型(LLM)的发展,越来越多的研究开始探索利用LLM自动生成数据准备工作流,但由于LLM难以理解表格数据的结构,并且缺乏面向下游任务性能的目标优化,限制了模型的最终表现.为此,本文提出了一种新颖的基于大小模型协同优化的表格数据准备工作流生成框架——LLMPipe.该方法首先充分利用大语言模型在语义理解与知识泛化方面的优势,结合任务描述与上下文信息,生成具有针对性和领域适应性的定制化数据准备操作;随后,引入轻量级模型对操作特征进行建模,并利用强化学习算法优化操作排序策略,从而实现对数据准备流程的动态编排.该框架通过"大模型扩充、小模型调优"的协同方式,在保障领域知识理解能力与高质量工作流组合能力的同时,提高了整体计算效率,有效增强了生成工作流的定制性与合理性.本文在Kaggle平台上的多个真实机器学习任务上开展了大量实验.实验结果表明,相较于现有方法,本文提出的框架在机器学习任务上的准确性取得了显著提升,达到了当前最优水平.

Owing to the development of big data and artificial intelligence,industry users are increasingly leveraging machine learning for data analysis.This study focuses on data preparation for machine-learning scenarios to automatically construct a high-quality data-preparation pipeline for a specified machine-learning task(including a tabular dataset,training objective,and model configuration).Existing methods typically rely on deep neural networks and require a predefined and limited operation space for data preparation,making it difficult to satisfy customization demands.Researchers are increasingly investigating the use of large language models(LLMs)to automatically generate data-preparation pipelines.Nevertheless,LLM have difficulty understanding the structure of tabular data and lack performance-oriented optimization for downstream tasks.This ultimately limits model performance.Hence,this study proposes a novel framework named LLMPipe to generate a tabular-data preparation pipeline based on the optimization of large and small models.The method first leverages the advantages of LLM in semantic understanding and knowledge generalization to generate customized and domain-adaptive data-preparation operations by incorporating task descriptions and contextual information.Subsequently,it introduces a lightweight model to model operation features and uses reinforcement learning to optimize the operation ordering strategy,thereby dynamically orchestrating the entire data-preparation pipeline.Based on a collaborative"large-model expansion and small-model tuning"approach,the framework preserves the ability to understand domain knowledge and compose high-quality pipelines while improving overall computational efficiency and effectively enhancing the customizability and rationality of the generated pipelines.Extensive experiments are conducted across multiple real-world machine-learning tasks from Kaggle.The results reveal that the proposed method significantly outperforms existing methods,with state-of-the-art accuracy achieved across machine-learning tasks.

陈思蓓;韩宵玥;范举;杜小勇

重庆大学计算机学院,重庆 401331||中国人民大学信息学院,北京 100872中国人民大学信息学院,北京 100872中国人民大学信息学院,北京 100872||中国人民大学数据工程与知识工程教育部重点实验室,北京 100872中国人民大学信息学院,北京 100872||中国人民大学数据工程与知识工程教育部重点实验室,北京 100872

信息技术与安全科学

机器学习数据准备工作流强化学习大语言模型自动机器学习

machine learningdata preparation pipelinereinforcement learninglarge language modelautomatic machine learning

《华东师范大学学报(自然科学版)》 2026 (5)

95-108,14

国家自然科学基金(62436010,62441230)教育部中央高校青年教师科研创新能力支持项目(RICSPYF-ZY2025001)

10.3969/j.issn.1000-5641.2026.05.008

评论