首页|期刊导航|信息工程大学学报|潜在语义聚类与图交互驱动的少样本文本分类

潜在语义聚类与图交互驱动的少样本文本分类OA

Latent Semantic Clustering and Graph Interaction Driven Few-Shot Text Classification

中文摘要英文摘要

针对少样本长尾分类中尾部类别样本稀缺、预训练语言模型拟合不足及现有图方法依赖全局静态结构的问题,提出一种基于潜在语义聚类与图交互的文本分类方法.首先,利用标签描述对语言模型进行语义预热,使文本与标签对齐到统一表示空间;其次,通过无监督聚类构建可学习的潜在主题节点,作为文本与标签的语义中继,以缓解尾部类别语义稀疏;最后,为每个文本实例动态构建独立的异质子图,通过图神经网络聚合局部信息,并以交叉注意力机制增强文本表征.在5个基准数据集上的实验结果表明,该方法与BERT、RoBERTa、DeBERTa等3类基准微调模型结合后,宏平均F1值平均提升2.91个百分点、尾部类别宏平均F1值平均提升3.21个百分点,尾部性能提升更为显著,且显存开销远低于全局图方法,为少样本不平衡分类提供兼顾性能与效率的解决方案.

To address the issues of scarce tail-class samples,insufficient fitting of pre-trained language models,and the reliance on global static structures in existing graph-based methods for few-shot long-tail classification,a text classification method based on latent semantic clustering and graph interaction is proposed.Firstly,the language model is semantically warmed up using label descriptions to align texts and labels into a unified representation space.Secondly,learnable latent topic nodes are constructed through unsupervised clustering to serve as semantic relays between texts and labels,thereby alleviating the semantic sparsity of tail categories.Finally,an independent heterogeneous subgraph is dynamically constructed for each text instance,local information is aggregated via a graph neural network,and text representations are enhanced through a cross-attention mechanism.Experimental results on 5 bench-mark datasets demonstrate that after integrating the proposed method with 3 fine-tuned baseline models(BERT,RoBERTa,and DeBERTa),the macro F1 score of the models is improved by 2.91 percentage points,and the macro tail F1 score is improved by 3.21 percentage points,showing a more significant en-hancement in tail performance.Furthermore,its memory overhead is significantly lower than that of global graph methods,offering an effective and efficient solution for few-shot imbalanced classification.

王世宇;周刚;卢记仓

信息工程大学,河南 郑州 450001信息工程大学,河南 郑州 450001信息工程大学,河南 郑州 450001

信息技术与安全科学

文本分类语义聚类图神经网络预训练模型类分布不均衡

text classificationsemantic clusteringgraph neural networkpre-trained modelclass distribution imbalance

《信息工程大学学报》 2026 (3)

345-353,9

河南省自然科学基金(222300420590)

10.3969/j.issn.1671-0673.2026.03.014

评论