首页|期刊导航|计算机科学与探索|基于高效思维链微调的图表示学习方法

基于高效思维链微调的图表示学习方法OA

Efficient Chain-of-Thought Guided Instruction Tuning for Graph Representation Learning

中文摘要英文摘要

大语言模型在自然语言理解与多步推理任务中展现出强大能力,如何将其推理优势推广至图结构任务成为当前图学习的重要方向.然而,直接应用大语言模型处理图数据面临着模态差异大、结构信息难以有效编码等挑战.针对现有方法在图文对齐不充分、推理过程缺失导致调优成本高等问题,提出了一种基于高效思维链微调的图表示学习方法GraphCoT.该方法核心在于设计高质量的思维链蒸馏机制,通过高性能教师模型生成包含中间推理路径的指令数据,可以显式引导学生模型学习多步推理路径,实现少量数据条件下的高效指令微调.同时GraphCoT设计图文对齐模块实现图结构表示与语言空间的跨模态对齐,并提出轻量化双阶段训练策略,优先对齐模态再进行任务微调,该方法在兼顾推理效率与迁移能力的同时显著降低了训练成本.在多个基准数据集进行的节点分类与链接预测实验结果表明,GraphCoT在准确率、泛化性等方面均优于现有主流图学习方法,也验证了思维链蒸馏机制与对齐策略在图表示学习任务中的有效性.

Large language models(LLMs)have demonstrated remarkable capabilities in natural language understanding and multi-step reasoning.Transferring these reasoning advantages to graph-structured tasks has become a crucial direction in graph learning.However,directly applying LLMs to graph data faces challenges such as significant modal disparity and the difficulty of effectively encoding structural information.To address the limitations of existing methods,including insufficient graph-text alignment,the absence of explicit reasoning processes,and high fine-tuning costs,this paper proposes GraphCoT,a graph representation learning approach based on efficient chain-of-thought(CoT)fine-tuning.The core of this approach lies in a high-quality CoT distillation mechanism,where a powerful teacher model is used to generate instruction data containing intermediate reasoning paths,thereby explicitly guiding the student model to learn multi-step reasoning with minimal training data.Additionally,GraphCoT introduces a graph-text alignment module to achieve cross-modal alignment between graph representations and language space,and adopts a lightweight two-stage training strategy that prioritizes modal alignment before task-specific fine-tuning.This approach significantly reduces training costs while balancing efficiency and transferability.Experimental results on node classification and link prediction tasks across multiple datasets demonstrate that GraphCoT outperforms existing state-of-the-art methods in accuracy and generalization,validating the effectiveness of both the CoT distillation mechanism and the proposed alignment strategy in graph representation learning.

王艺铭;李倩;杜云涛;崔立真;闫中敏

山东大学 软件学院,济南 250101山东大学 山东大学-南洋理工大学人工智能国际联合研究院,济南 250101山东大学 山东大学-南洋理工大学人工智能国际联合研究院,济南 250101||南京大学 计算机软件新技术国家重点实验室,南京 210023山东大学 软件学院,济南 250101||山东大学 山东大学-南洋理工大学人工智能国际联合研究院,济南 250101山东大学 软件学院,济南 250101

信息技术与安全科学

图表示学习思维链图编码器跨模态

graph representation learningchain-of-thoughtgraph encodercross-modal

《计算机科学与探索》 2026 (8)

2241-2250,10

国家自然科学基金(62402293)山东省自然科学基金(ZR2025QC1570)山东大学基础研究基金. This work was supported by the National Natural Science Foundation of China(62402293),the Natural Science Foundation of Shandong Province(ZR2025QC1570),and the Fundamental Research Fund of Shandong University.

10.3778/j.issn.1673-9418.2510056

评论