融合CINO-LoRA和Self-condition的DiffuSum藏文文本自动摘要OA
Automatic Summarization of Tibetan Texts Using DiffuSum with CINO-LoRA and Self-condition Integration
为进一步提升藏文文本自动摘要的性能,针对 DiffuSum 模型在藏文摘要任务中因句子表征能力不足、参数规模过大导致的上下文建模受限以及训练成本高等问题,提出一种融合 CINO-LoRA 与自调节(Self-condition)的藏文文本自动摘要模型 TiDiffuSum.该模型在句子编码器中引入 CINO-LoRA 机制,以增强藏文语义表征并显著减少训练参数量;在扩散生成模块中集成 Self-condition 策略,加强对上下文语义的理解与利用.实验结果表明,TiDiffuSum 在藏文摘要数据集 TSUM 上能够将参数量有效压缩至基线模型的 0.45%,且ROUGE-1,ROUGE-2 和 ROUGE-L 指标分别提升 1.07,0.78 和 1.08,显著优于基线模型.
To further improve the performance of Tibetan text automatic summarization,the paper proposes a Tibetan text summarization model TiDiffuSum,which integrates CINO-LoRA and Self-condition into the DiffuSum to address issues of insufficient sentence representation,large parameter scale limiting contextual modeling,and high training costs in the Tibetan task.TiDiffuSum model introduces CINO-LoRA mechanism into the sentence encoder to enhance Tibetan semantic representation and significantly reduce the number of training parameters.Additionally,it incorporates Self-condition strategy in the diffusion generation module to strengthen the comprehension and utilization of contextual semantics.Experimental results indicate that TiDiffuSum can effectively reduce the parameter count to 0.45%of the baseline model on the Tibetan summarization dataset(TSUM),and achieves improvements of 1.07,0.78,and 1.08 in ROUGE-1,ROUGE-2,and ROUGE-L scores,significantly outperforming baseline models.
王蓉;才智杰
青海师范大学计算机学院,西宁 810016||藏语智能全国重点实验室,西宁 810008青海师范大学计算机学院,西宁 810016||藏语智能全国重点实验室,西宁 810008
藏文文本自动摘要DiffuSum模型句子表征
Tibetantext automatic summarizationDiffusum modelsentence representation
《北京大学学报(自然科学版)》 2026 (2)
266-274,9
国家自然科学基金(616966031,6186646462)资助
评论