基于LLM概率提示词的表格数据生成方法OA
A method for generating tabular data based on LLM prompt words
大语言模型(Large Language Model,LLM)在生成表格数据任务中展现出巨大潜力,但其生成的数据往往难以准确保持数据列间的依赖关系.针对该问题,提出一种基于LLM概率提示词的方法TabProLLM,分别生成表格数据的数值列和分类列.使用高斯混合模型(Gaussian Mixture Model,GMM)切分数值列的概率密度曲线,将其划分为多个正态分布,并基于划分后的正态分布构造概率提示词用于大模型生成数值列数据.对于分类列,以某一数值列为基准进行分区,计算分类列中各类别在不同数值区间的条件概率分布,并根据条件概率分布生成提示词用于生成分类列数据.在提示词生成过程中,还引入相关系数等指标,用于校验生成数据中变量间的依赖关系是否符合原始数据的相关性模式.在10个公开数据集上的实验结果表明,TabProLLM在保证数据隐私性的同时,在SDMetrics工具中的RangeCoverage,CategoryCoverage,KSComplement,TVComplement等多个保真度评估指标上实现了18%左右的性能提升.其相关性指标CorrelationSimilarity与最优模型TabDDPM基本持平,和GPT-4o使用均值方差提示词方法相比,提升约4.1%.同时,在隐私性评估方面,TabProLLM的DCR和NNDR(取第5百分位数)指标整体表现为最优和次优.
Large Language Model(LLM)have demonstrated significant potential in tabular data generation.However,they often struggle to accurately preserve the statistical dependencies between columns.To address this challenge,we propose TabProLLM,a probabilistic prompting framework that separately generates numerical and categorical columns using strategies grounded in probability distributions.For numerical columns,we fit a Gaussian Mixture Model(GMM)to decompose the empirical distribution into multiple Gaussian components.Prompts are then constructed based on these segmented distributions to guide the LLM in generating realistic numerical values.For categorical columns,we condition on a reference numerical column by partitioning its range and computing the conditional probability distribution of each category within each interval.These conditional probabilities are embedded into the prompt design to steer the generation of categorical data consistent with observed inter-variable dependencies.During prompt construction,correlation coefficients and other statistical measures are incorporated to verify that the generated data preserves the correlation structure of the original dataset.Experimental results on 10 public datasets show that TabProLLM,while ensuring strong data privacy,achieves performance gains of 0.5%to 18.3%over existing methods across multiple fidelity metrics in the SDMetrics toolkit,including RangeCoverage,CategoryCoverage,KSComplement,and TVComplement.On the CorrelationSimilarity metric,TabPro-LLM performs comparably to the state-of-the-art TabDDPM model and surpasses GPT-4o(using mean-variance prompts)by approximately 4.1%.Furthermore,in privacy evaluations,TabProLLM achieves top or second-best performance across DCR and NNDR metrics(evaluated at the 5th percentile),highlighting its robust privacy-preserving capabilities.
张爽;房俊;欧阳琛
北方工业大学信息学院,北京,100144北方工业大学信息学院,北京,100144||大规模流数据集成与分析技术北京市重点实验室,北方工业大学,北京,100144北方工业大学信息学院,北京,100144
信息技术与安全科学
表格数据生成大语言模型提示词条件概率
tabular data generationlarge language modelprompt wordsconditional probability
《南京大学学报(自然科学版)》 2026 (2)
277-284,8
国家重点研发计划(2023YFC3107900),国家自然科学基金(72272140)
评论